UBIQUITY OF KOSTKA POLYNOMIALS 

ANATOL N. KIRILLOV 

Graduate School of Mathematics, Nagoya University 
Chikusa-ku, Nagoya 486-8602, Japan 
and 

Steklov Mathematical Institute, 
Fontanka 27, St. Petersburg, 191011, Russia 

Abstract 

We report about results revolving around Kostka-Foulkes and parabolic Kostka 
polynomials and their connections with Representation Theory and Combinatorics. It 
appears that the set of all parabolic Kostka polynomials forms a semigroup, which 
we call Liskova semigroup. We show that polynomials frequently appearing in Rep- 
resentation Theory and Combinatorics belong to the Liskova semigroup. Among such 
polynomials we study rectangular g-Catalan numbers; generalized exponents polyno- 
mials; principal specializations of the internal product of Schur functions; generalized 
g-Gaussian polynomials; parabolic Kostant partition function and its g-analog; cer- 
tain generating functions on the set of transportation matrices. In each case we apply 
rigged configurations technique to obtain some interesting and new information about 
Kostka-Foulkes and parabolic Kostka polynomials, Kostant partition function, MacMa- 
hon, Gelfand-Tsetlin and Chan-Robbins polytopes. We describe certain connections 
between generalized saturation and Fulton's conjectures and parabolic Kostka polyno- 
mials; domino tableaux and rigged configurations. We study also some properties of 
/-restricted generalized exponents and the stable behaviour of certain Kostka-Foulkes 
polynomials. 
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1 Introduction 



The Kostka-Foulkes polynomials K\^[q) are defined as the matrix elements of the transition 
matrix which expresses the Schur functions s\{x) in terms of the Hall-Littlewood symmetric 
functions q): 

sa(x) =^i^AM(g)P,,(a^;g)- (1-1) 

To our knowledge, at the first time the polynomials Kx^{q) had appeared implicitly in 
the middle of fifties in the familiar series of papers by Green [|l^, |19] about computation of 
the characters of the general linear groups over finite fields and their connections with the 
Hall-Steinitz algebra. The famous Green polynomials Qp{q) are related to the polynomials 
K\^{q) via the following relation 

q-(>^^Q^^{q-') = J2xiK,,iq), 

X 

where Xp is the value of the irreducible character x'*' of the symmetric group Sn at elements 
of cycle-type p. Later in the paper D.E. Littlewood introduced the symmetric functions 

Q'x{x;q)= n (1-?^u)"'^a(x), (1.2) 

l<i<j<n 

where RijSx{x) := sr,^.(a)(x), and Rij{\) = (Ai, . . . , Aj + 1, . . . , - 1, . . . , A„) is the so- 
called raising' operator, see e.g. [0, Chapter I, §1. Here and further s\{x) denotes the Schur 
function corresponding to a partition (or composition) A, and to the set of variables xi, . . . , x„. 
In the same paper D.E. Littlewood also computed a few examples of the decomposition of 
function Q'x{x]q) in terms of Schur functions. The functions Q'xix^q) are called modified 
Hall-Littlewood polynomials and related with polynomials Kxp{q) via a simple relation 

Q',{x-^q) = Y.^^Msx{x). (1.3) 

A 

Polynomials Kx^{q) also appeared implicitly, via the generalized exponents of certain mod- 
ules, in a fundamental paper by Kostant [H2 . 



Probably, A.O. Morris [Q was the first who introduced a special notation fxti{t) for the 
transition coefficients between the modified Hall-Littlewood polynomials Q'x{x;t) and Schur 
functions s^{x), i.e. for Kostka-Foulkes polynomials. Using the Littlewood formula ([L^), 
A.O. Morris discovered an important recurrence relation between the polynomials Kxn{q), 
and computed all those polynomials with |A| = |yu| < 4. 

In a survey paper |0 H.O. Foulkes at the first time, as far as I am aware, gave rise the 
problem of non-negativity of the coefficients of polynomials Kxp,{q)- He stated a problem "to 
associate each Young tableau with a precise index of g". This problem was settled by A. Las- 
coux and M.-P. Schiitzenberger [^4|, ^ who suggested the name "Foulkes polynomials" for 



polynomials Kxp{q). Later they renamed these polynomials by Foulkes-Green polynomials, 
see e.g. ISf, and C.R. Acad. Sci., Paris 288 (1979), 95-98. 
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In the middle of seventies the polynomials Kxfj,{q) had appeared in Algebraic Geometry 
and Representation Theory in a connection with the study of the so-called "variety of the A^- 
stable complete flags Bjy"; the crucial papers here are those by R. Steinberg (1976), R. Hotta 
and T. Springer (1977), T. Springer (Inv. Math. 36 (1976), 173-207), H. Kraft (1981), and 
C. De Concini and C. Procesi (1981). Precise references may be found in [^. In a paper by 
Garsia and Procesi |1^ the polynomials Kx^lq) are named by g-Kostka polynomials. 

There exists a vast body of literature about the Schur and Hall-Littlewood functions, their 
numerous applications to Representation theory of the symmetric and general linear groups 
5^ , |59| , |54| , to Enumerative combinatorics [Q, Algebraic geometry [l^, |l5l, to Integrable 
systems .... But it is surprisingly enough that till now there are no books or 

survey articles (except [|^) which would describe a big variety of applications of Kostka- 
Foulkes polynomials to different areas of Mathematics and Mathematical Physics. 

The present paper is an attempt to collect together some results about the Kostka-Foulkes 
and parabolic Kostka polynomials related mainly to Representation theory and Combina- 
torics. Thus, we almost omitted very interesting connections of polynomials Kx^{q) with 
Algebraic geometry, as well as with Integrable systems. Some examples of such connections 
one may find in p|, p|, Rl ESl EO, |5l 



61], pi, m 



The main problems we are going to consider and study in the present paper are Identifi- 
cation and Characterization problems. 

i) Characterization problem: how to characterize polynomials with non-negative integer 
coefficients which might appear to be a Kostka-Foulkes (or parabolic Kostka) polynomials 
K\^{q) (or KxR^q)) for some partitions A and fi (or for some partition A and dominant 
sequence of rectangular shape partitions R)7 

If such an occasion happened, i.e. 

P{q) = KxRiq), 

one can apply fermionic formula for polynomials Kx^{q) (or Kxniq)), see Theorem [4.3| and 



Corollary ^jj, to obtain a deep information about polynomial P{q)- Typical example is the 

A^ 

. One can prove ||3^ that 

1 



generalized binomial coefficients 



A 



N 
X' 



= K~xrM) 



-1 1 



where A = (A^|A|,A), /I = (lAI^"*"^), and the symbol = is explained in the list of special 
notation (Notatition) at the end of Introduction. In this way one comes to the following 
identity 



A^ 
A' 



E«""' n 



-I 9 



u) + mj[u 



M j,k>i 

summed over all sequences of partitions {u} = z/*-^-*, . . .} such that 



:i.4) 
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jiN + l)5k,i + Q,iu 



2gj(z/('=)) + gj(z/(*^+i)) > 0, for all k,j > 1; 



mj{u^^^) is the number of parts of partition z/*^^) of size j; 



c(z/) =n(z/«)-n(A)+ ^ 

fcj>i 



(fc)y 



(g;g)m(g;g)r 



if < m < n, and equals to otherwise. 



The identity (O) is a highly non-trivial identity, which generalizes the so-called KOH 
identity, see e.g. [^, or Section ||, ( [4.5|) . The only known proof of ( |1.4|) is a combina- 



the generalized Gaussian polynomials 



(cf. D. Zeilberger, IMA volumes in Math, and 



torial one and based on a construction of the rigged configurations bijection, see p2| , |35[] . For 
further generalization of the identity ( |1.4| ) see Section H, ( |6.13| ), or Section 10.1. It was 
shown [ihi(jl\ that " a constructive proof of the unimodality of the Gaussian coefficients" , which 
is due to O'Hara |^|, admits a natural interpretation in terms of rigged configurations. Note 
also, that identity (|1.4| ) leads to " a one-line high school algebra proof of the unimodality of 

n 
^ X 

Appl., 18 (1989), 67-75). 

Characterization problem appears to be a rather difficult one, and we don't know a com- 
plete list of conditions for a given polynomial P{q) G to be a parabolic Kostka poly- 
nomial. Examples show that in general the sequence of coefficients of a parabolic Kostka 
polynomial Rxniq) may be not symmetric or unimodal, and may have gaps, i.e. if 

KxRiq) = q*iao + aiq^ ha^g""), aoO^ 7^ 0, 



then it may be exist an index j, 1 < j < m 
plausible the following 



1, such that a, = 0. Nevertheless, it seems 



Conjecture 1.1 Let 



P{q) = ^a^g'^ 



be a polynomial with non-negative integer coefficients such that a„am 7^ 0, ctn-i = 0. // there 
exist non-negative integers i and j , n < i < j < m, such that j — i > 2, and aj_i < flj > 



ai+i > ■■■ > 
polynomial. 



a,- < a 



then the polynomial P{q) can't be equal to any parabolic Kostka 



ii) Identification problem: even though an answer to the Characterization problem is still 
unknown, it is possible to identify some polynomials, which frequently appear in Combina- 
torics and Representation theory, with certain parabolic Kostka polynomials. 

One of the main goals of our paper is to show that among polynomials, which occur as 
parabolic Kostka polynomials, are the following: 

• rectangular g-Catalan numbers. Section |, Exercise 1; 

• generalized exponents polynomials. Theorem |5.3| ; 

• principal specialization of the internal product of Schur functions. Theorem |6.6| ; 
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generalized g-binomial coefficients, Section [7^ ; 
g-multinomial and g^-multinomial coefficients, Section [7l3 



g-analog of Kostant's partition function. Section |^, Exercise 2; 



• certain generating functions on the set of transportation matrices. Section |7.4| ; 

• polynomials n(l + g)™, where n > 1 and m > 2 are integer numbers. Section |, 
Exercise 6. 

The main purpose of the present paper is to study combinatorial properties of these 
polynomials, which follow from identification of the polynomials above with certain parabolic 
Kostka polynomials, by means of the rigged configurations bijection. 

Let us say a few words about the content of our paper. 

In Section we recall definitions of Kostka-Foulkes polynomials, weight multiplicities, 
and g-weight multiplicities. Exercises to Section ^ include, among others, definitions and 
basic properties of the rectangular g-Catalan and g-Narayana numbers, computation of the 
volume and ^-vector of MacMahon's polytope. 

In Section ^ we recall the definition of parabolic Kostka polynomials which are natural 
generalization of the Kostka-Foulkes polynomials. More details and proofs may be found in 
iO[| . Exercises to Section |^ include, among others, a g-analog of a result by J. Stembridge 
67[| about the number of up-down staircase tableaux, see Exercise 7; connection between 
Littlewood-Richardson's numbers c^^ and certain parabolic Kostka polynomials, see Exer- 
cise 3; various combinatorial properties of the convex polytope 

Vn = {{Xi,...,Xn) e M+l Xi+Xi+i < 1, 1 < i < n - 1}, 

including fermionic formulae for the number i(P„; k) of integer points inside of the poly- 
tope kVn] connections with restricted Kostka polynomials and alternating permutations, see 
Exercise 4. 

In Section ^ we recall a fermionic formula for parabolic Kostka polynomials. Proof of the 
fermionic formula for parabolic Kostka polynomials is based on the study of combinatorial 



properties of the rigged configurations bijection, and may be found in see also 



Exercises to Section ^ include, among others, an explanation of certain connections between 
domino and p-ribbon tableaux on one hand and parabolic Kostka polynomials and rigged 
configurations on the other, see Exercises 3 and 4; "exotic examples" of parabolic Kostka 
polynomials, which have a few non-zero terms only. It is a very interesting and difficult 
problem to find all parabolic Kostka polynomials with 2,3 or 4 non-zero terms. 

In Section |^ we study the generalized exponents polynomials for some representations of 
the Lie algebra sl{n). The generalized exponents polynomials were introduced and studied in 
the familiar paper by Kostant in a connection with the investigation of the structure of the 



symmetric algebra of the adjoint representation. Our main observation is that the generalized 
exponents polynomial G^iVa^V^) corresponding to the tensor product V^®Vg* of irreducible 
0/(A^)-representation Va and the dual 0/(A^)-representation Vj^, after multiplication by some 
power of g, coincides with a certain parabolic Kostka polynomial, see Theorem |5.3| . This 
observation leads to a fermionic formula for generalized exponents polynomial corresponding 
to 0/(A^)-representations of the form Va ® Vg* and gives the ffist real means for computing 
polynomials Giy{Va <S) V^). We give also a generahzation of the Gupta-Hessenlink-Peterson 
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^ and Theorem 5.12. 



theorem (Theorem to the case of so-called /-restricted generalized exponents polynomial, 
see Definition 
In Section 
cializations. 



we study the internal product of Schur functions and its principal spe- 
lt looks a challenging problem to find and prove an analog of the Lascoux- 
Schiitzenberger theorem about Kostka-Foulkes polynomials (see e.g. Chapter III, (6.5), 



(i)) for the transition coefficients L^^^^q) between the internal product of Schur functions and 
Hall-Littlewood polynomials 



see Section ^, Problem for further details. 

Polynomials L^^^ (q) have many interesting properties (see Proposition |6.3| and Exercises 1 
and 2 to Section ^), and may be considered as a natural generalization of the Kostka-Foulkes 
polynomials Ka^{q). Note that numbers 



are equal to the structural constants for multiplication of the characters of the symmetric 
group Sia\- 



^9a(^,iX^- 



Recall that it is an important open problem to obtain a nice combinatorial interpretation 
of the numbers Qaf^^i- Based on an observation, see our Theorem |6.6| , that the princi- 
pal specialization of a Schur function after multiplication by some power of q, coincides 
with a certain parabolic Kostka polynomial, we obtain a new proof, see Corollary |6.7| , of 
a fermionic/combinatorial formula for the principal specialization of Schur functions first 
obtained in |]31| . 

In Section ^ we study Identification problem. Our first result states that the set of all 
polynomials, which may occur as a parabolic Kostka polynomial, forms a semigroup, i.e. 
closed under multiplication. We call this semigroup by Liskova semigroup. We show that 

Liskova semigroup contains the generalized g-Gaussian polynomials 



A' 



, g-multinomial 



coefficients 



N 



Ui, 



g-analog of Kostant's partition function, and polynomials related 



to the Robinson-Schensted-Knuth correspondence between the set of transportation matrices 
and that of pairs of semistandard Young tableaux of the same shape. More precisely, let A 
and /i be compositions whose lengths do not exceed n. Denote by Vx^ the set of all by n 
matrices of non-negative integers with row sums Aj and column sums /ij (the so-called set 
of transportation matrices of type (A;yu)). The Robinson-Schensted-Knuth correspondence 
establishes a bijection 

^ II STY{r,, fi) X STY{7], A) (1.5) 
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between the set of transportation matrices V\fi and that of all pairs (P, Q) of semistandard 
Young tableaux of the same shape and weights fi and A correspondingly. 

Thus, for any transportation matrix m G Vx^ one can associate the following statistics: 

• left charge CLim) = c{P), 

• right charge Cji{m) = c{Q), 

• total charge c(m) = c(P) + c(Q). 

It is well-known that the generating function 

E ^'''^"'^=J2^^^^vxiQ)--='PM (1-6) 

describes 

i) dimensions of cohomology groups of the partial unipotent flag variety JF^ 



k>0 



see e.g., Hotta R. and Shimomura N., Math. Ann. 241 (1979), 193-208, or P 



ii) unrestricted one dimensional sum corresponding to the highest weight A and the tensor 
product of one row representations 

where /x = (//i, ...,///) and / = /(/i). For definition and basic properties of one dimensional 
sums, their connections with Kostka-Foulkes polynomials, with crystal basis, and integrable 
models, see e.g. and the literature quoted therein; 

iii) the number a\{S]p) of chains of subgroups 

{e} C C . • . C C G 

in a finite abelian p-group of type A such that each subgroup has order 1 < i < m: 

where S = {ai < a2 < ■ ■ ■ < ctm} is a subset of the interval [1, |A| — 1], and 

m-, 



see e.g. |p|, or 



iv) the number of rational points JF^(Fg) over the finite field of the partial unipotent flag 
variety JF^: 

In particular, if A = (1") then 



n 
, . . . , 

see e.g. ( |2.25| ), and hence V(in)^{q) belongs to the Liskova semigroup. 



Question. Is it true that polynomials V\^{q) belong to the Liskova semigroup for all parti- 
tions A and compositions /i? 
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Conjecture 1.2 Let P{q) be a polynomial with non-negative integer coefficients and non- 
zero constant term. There exist two polynomials fi{q) and f^iq) both belonging to the Liskova 
semifroup, such that P{q) = fi{q)/f2{q)- 



For a "strong version" of this conjecture, see Section 7.1. 



In Section |7.4| we study the generating functions 

J2 g^(-) = J2^vAQ)K,x{q), (1.7) 

J2 g^(-) = J^^v'MK.xiq), (1.8) 

where 72. a/^ denotes the set of all (0, l)-matrices of size nhy n with row sums Aj and column 
sums Hj. 

It happens that the generating function ( |1.7|) coincides with a certain Kostka-Foulkes 
polynomial, see Theorem [7.13| , whereas the generating function (|1.8| ) coincides with a certain 



"super" Kostka-Foulkes polynomial, see Theorem [7.14 . 

In Section |7^ for any two partitions A and of the same size, we introduce Ehrhart 
polynomial £\^{t) of the weight subspace V\{ii). Namely, using the specialization g = 1 of 
fermionic formula ( [4.2|) for Kostka's polynomials, it is not difficult to see that the Kostka 
number Ki\^i^ is a polynomial in I with integer coefficients. Based on examples, we state a 
conjecture that Ehrhart's polynomial Sxii{t) has in fact non-negative integer coefficients. This 



conjecture would follow from the general theory of Ehrhart's polynomials, see e.g. if 
it would be known that the Gelfand-Tsetlin polytope G(A,/x), see Section |7]^, is an integral 
one (this is the so-called Berenstein-Kirillov conjecture, see [^, p. 101, Conjecture 2.1). 
More generally, it follows from the q = 1 case of the fermionic formula ([4.1|) that for any 
partition A and any sequence of rectangular shape partitions R the parabolic Kostka number 
Kix^iR is a polynomial £x,r{1) in / with integer coefficients. Based on examples, we make 
a conjecture that the polynomial Sx^nit) has in fact non-negative integer coefficients. We 
expect that the similar statements are valid for (generalized) parabolic Kostka numbers 

Klx,l^,T) '■= Kix,i^^riiq)\q=l- 

It looks a challenging problem to find an explicit formula for the Ehrhart polynomials 
Sx^(t). This problem should be a very difficult one, however, since, for example, the poly- 
nomial S(^n"),{(n-iy\i"){t) coincides with the Ehrhart polynomial of the Birkhoff polytope Bn, 



see Example |7.19| . The (normalized) leading coefficient of polynomial £xii{t) is equal to the 



(normalized) volume of Gelfand-Tsetlin's polytope (j'(A,/i), and is known in the literature 
(see e.g., G.J. Heckman, Inv. Math. 67 (1982), 333-356) as a continuous analog of the weight 
multiphcity d\mVx{^j). 

Finally, in the Exercises to Section |^ among others, we study some properties of the 
parabolic Kostant partition function i^'$(^)(7; 1), its g-analog, as well as its connections with 
parabolic Kostka polynomials, and the volume of so-called Chan-Robbins polytope, see 
Exercise 2. Kostant's partition function was introduced and studied by F.A. Berezin and 
I.M. Gelfand (Proc. Moscow Math. Soc. 5 (1956), 311-351) for the case q = sl{n), and by 
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B. Kostant (Trans. Amer. Math. Soc, 93 (1959), 53-73) for arbitrary semi-simple finite 
dimensional Lie algebra q. In we had considered in details algebraic and combinatorial 
properties of the Kostant partition function i^(in)(7;l), and, in particular, computed the 
values of function i^(in)(7; 1) for certain vectors 7, see Exercise 2 c, e-g to Section 0. It is 
not difficult to see (Exercise 2d to Section |^) that if 

7 = (7i,---,7n)eZ", |7| = 0, 

then the value of Kostant's partition function i^(in-)(7; 1) is equal to the number of n by 
n skew-symmetric integer matrices m = {mij)i<i j<n with row sums 7^ and column sums 
— 7j, such that rriij > 0, if i < j. We denote by SM{'y) the set of all such skew-symmetric 
matrices. It is natural to ask does there exist an analog of the Robinson-Schensted-Knuth 
correspondence for the set of "skew-symmetric" transportation matrices SM{pf)l We don't 
know any answer on this question in general, but in a particular case when 

7 = (rf, d + 1, . . . , + n - 1, -n{2d + n - l)/2), 

we suggest such a bijection, see ( [7.22| ), Exercise 2c to Section 0. We show also (Exercise 2h 
to Section 0) that the Ehrhart polynomial S{CRn]t) of the Chan-Robbins polytope Ci?„ 
is equal to the "continuous analog" 'P$(^)(/?) of the Kostant partition function _ft'<j,(^)(/5, 1). 
Namely, 

£{CRn-, t) = P$(in+i)(t, 0, . . . , 0, —t). 

n-l 

Using a "fermionic formula" for the Kostant partition function and its continuous analog in 
the dominant chamber Y^_^-^ obtained in |3^, we had computed the leading coefficients of 



the Ehrhart polynomial £{CRn',t), and hence, the volume of Chan-Robbins' polytope Ci?„. 
Formula for the volume of Chan-Robbins polytope was conjectured in 0, and has been 
proved for the first time by D. Zeilberger In Exercise 4 we state a generalized saturation 
conjecture, and discuss connections between the saturation conjecture (now a theorem by 
A. Knutson and T. Tao, J. Amer. Math. Soc. 12 (1999), 1055-1090) and parabolic Kostka 
polynomials. More precisely, for any two partitions A and /i, and a composition rj such that 
I'?! > ^(/^) we define numbers a{X,fi;ri) and b{X,fi]ri) via the decomposition 

K\^r){<l) = q°'^'^'^'^^b{X, j2;ri) + higher degree terms. 

The numbers a(A, fi; rj) and 6(A, fi; rj) seem to have many interesting combinatorial properties. 
For example, the Littlewood-Richardson numbers c^^ are a special case of the numbers 
6(A, yu; rj), see Section ^ Example 3. In Example 4 (to Section |^ we state several conjectures 
about the numbers a{X,fi;r]) and b{X,fi]ri). The basic two are: 

• generalized saturation conjecture: 

a{nX, nfi] rj) = na{X, /i; rj) for any positive integer n; 

• generalized Fulton's conjecture: 

if b{nX, nfi; rj) = 1 for some positive integer n, then b{NX, Nfi; 77) = 1 for any positive 
integer N. 
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In Section |^ we study the limiting behaviour of certain Kostka-Foulkes polynomials. We 
give a generalization, see Theorem ^.3| , of a result obtained by Stanley |6^, and give answers 
on some questions had been posed in . 



Each Section, except for the first one, ends with a series of exercises (which total number 
exceeds one hundred) . The exercises vary in difficulty: some are straightforward applications 
of the material presented, while others are more difficult and represent a brief exposition of 
original works or taken from various papers written by the author. 

The bibliographic notes are kept very brief. They are not intended to give a comprehensive 
historical account or a complete bibliography of the respective subject areas. 

Notation 

Throughout the paper we follow to Macdonald's book as for notation related to the 



theory of symmetric functions, and Stanley's book |£6| as for notation related to Combina- 
torics. Below we give a list of some special notation which we will use 

1) if P{q) and Q{q) are polynomials in q, the symbol P{q) = Q{q) means that the ratio 
P{q)/Q{q) is a power of q; 

2) if a,ko,..., km are (non-negative) integers, the symbol q"'{ko, ■ ■ ■ , km) stands for poly- 
nomial '^^=okjq°'~^^ ; 

3) (Garsia's symbol x{P)) if P is any statement, then x{P) = 1 if it is true, and x{P) = 
otherwise; 

4) if A is a partition and /i is a composition, the symbol STY{X,fi) denotes the set of 
semistandard Young tableaux of shape A and weight (or content) /i. 

2 Kostka— Foulkes polynomials and weight multiplici- 
ties 

2.1 Kostka— Foulkes polynomials 

Kostka-Foulkes polynomials are defined as the matrix elements of the transition matrix 

K{q)=M{s,P) 

from the Schur functions S\{x) to the Hall-Littlewood functions P^{x; q): 

s^{x) = Y,KxM)P,i^-^(D- (2-1) 



It is well known [q^. Chapter I, that if A and /i partitions, then 

• K\n{q) 7^ if and only if A > /i with respect to the dominance partial ordering ">" on 
the set of partitions Vn- 

A > /i if and only if 

i) |A| = 

a) Ai + ■ • ■ + Aj > /ii + ■ ■ ■ + /ij for all i > 1. 
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• If A > /i, K\^{q) is a monic of degree n{^) —n{X) polynomial with non-negative integer 
coefficients. 

Let us recall that for any partition A = (Ai, A2, ■ ■ ■ , \p), 



i=l ^^i<j^P 



It was H.O. Foulkes [|T2| who asked for a combinatorial explanation of the positivity of 
coefficients of polynomials K\^{q). He conjectured the existence of natural statistics c(T) on 
the set of semistandard Young tableaux STY{X,fi) of shape A and weight /i such that 

Kx,{q)= Yl (2.2) 

TG5Ty(A,At) 



This conjecture was settled by Lascoux and Schiitzenberger who identified c(T) to 

be the rank of a poset structure on the set STY{»,fi) of semistandard Young tableaux of 
fixed weight /i. Another proof of the positivity of coefficients of polynomials Kx^{q) has been 
obtained by Lusztig ESI, who identified the polynomials 



with the certain Kazhdan-Lusztig polynomials Pnx,n^,{,<i) for the affine Weyl group W(Qln)- 

2.2 Skew Kostka— Foulkes polynomials 

Let A,/i and z/ be partitions, A D /i, and |A| = + |z/|. 

Definition 2.1 The skew Kostka-Foulkes polynomials Kx\^^i,{q) are defined as the transition 
coefficients from the skew Schur functions sx\i^i{x) to the Hall-Littlewood functions Pu{x;q): 

= Y,Kx\^,MP,{^;q)- (2.3) 

V 

It is clear that 

TV 

where the coefficients c"^^ = Mult[\4 : V^^K-] stand for the Littlewood-Richardson numbers. 
Let us remark that 

i^Aw(g) = $^g^(^) (2.4) 

T 

summed over all semistandard skew tableaux T of shape A \ /i and weight u, where c(T) 
denotes the charge of skew tableau T. 

We define also cocharge version of the skew Kostka-Foulkes polynomials: 

:^Aw(g) = 5^ci,:^.M(9), (2.5) 

TT 

where Kx^{q) = q'^^'^ KxM'^)- 
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2.3 Weight multiplicities 



Let \^ be a finite dimensional representation of tlie Lie algebra gl{n), and /i be an integrable 
weiglit (i.e. composition), denote by V{fi) the weiglit /i subspace of the representation V. 
Dimension dimV{n) of the space V{fi) is called weight multiplicity of /i in V. Let chV 
denote the character of representation V. It is a symmetric polynomial in variables Xn = 
{xi, . . . ,Xn)- If P is any polynomial in the variables Xn, let [x^]P be the coefficient of 
= Xi^ ■ ■ ■ x^" in P. It is clear that 

dim\/(/i) = [x^]chV. 

Follow S. Kato |2^, define a g-analog diiRgV (fi) of the weight multiplicity dimV"(/i) as the 
transition coefficient from the character chl^ to the Hall-Littlewood polynomials P^(X„; q): 

chV = ^dim,y(/i)P^(X„;g). (2.6) 

In the present paper we are mainly interested in the following two cases: 

i) ^ = ^ is an irreducible highest weight A representation of the Lie algebra Ql{n). 

In this case the character chVA of representation Vx coincides with the Schur function 

sx{Xn), and dimension dimVxifJ^) of the weight fi subspace of Vx is equal to the Kostka 

number 

Kx^. := Kx^{l), 

and is equal also to the number of semistandard Young tableaux of shape A and weight /i. 
It follows from ( ^.6] ) and ( |2.1D that the g-analog dimgVxifJ^) of weight multiplicity dimVx{fi) 
is equal to the Kostka-Foulkes polynomial Kx^{q). Polynomials Kx^{q) and the Lusztig 
g-analog of weight multiplicity d^{Lx]q) in the case of type A, see p. 215, (6.10), are 
connected by the following relation 

t/^(L,;g) = g"(^)-"WK,^(g-i). 
In the sequel, we will denote the Lusztig polynomials d^{Lx; q) by Kx^{q), so that 

KxM = q-^>'^-^'^Kx,{q-') = q-'^^'^KxM- (2-7) 



ii) V = = V(^^) (g) ■ ■ ■ ® V(^^) is the tensor product of irreducible representations V(^^) 
corresponding to the one row partitions (fia), 1 < a < and /i = (/ii, . . . , fir)- 

r 

In this case the character chV(^) is equal to the product Y\ (X„) of complete homo- 

i=i 

geneous symmetric polynomials h^.{Xn), 1 < j < r. The weight A multiplicity dimV(^)(A) is 
equal to the number Vxfi of n by n matrices of non-negative integers with row sums Aj and 
column sums fj,j: 

dimV^(^) (A) = K^f^K.x = Pam- (2.8) 

V 
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We denote by Vx^i the set of all n by n matrices of non-negative integers with row sums Aj 
and column sums /ij (the set of so-called transportation matrices of type (A; /i)). There exists 
a remarkable bijection, known as the Robinson-Schensted-Knuth correspondence, 

Vx^ - n STY{r], /i) X STY if], A) (2.9) 

between the set of transportation matrices of type (A; /i) and that of all pairs (P, Q) of 
semistandard Young tableaux of the same shape and weights /x and A, correspondingly. The 
Robinson-Schensted-Knuth correspondence ( |2.9[ ) leads to a combinatorial/bijective proof of 
the last equality in ( |2.8| ). 

Finally, let us find the g-analog, denoted by dimqV(^)(A), of multiplicity of the weight 
A in representation V(^). Using ( |2.6| ), (|2.1| ) and the product formula for the character of 
representation V(^): 

r 

chV(^)=n^M.(^n), 



one can obtain that 



dimgV^^) = Y^K^f^K^M ■■= VxM)- (2-10) 

11 

Polynomials Vx^{q) admit numerous algebraic, algebro-geometric and combinatorial inter- 
pretations. Some of them were mentioned in Introduction. Here we only mention a result by 
R. Hotta and N. Shimomura (Math. Ann. 24 (1979), 193-198) that the product f^^^^Vx^^it"^) 
is equal to the Poincare polynomial of the partial unipotent flag variety J^^: 



see 



t'^^^^Vxt.it-^) = 5]]dimif2fc(jr 
33, H3|, E^ and references therein. 



fc>0 



Exercises 

1. Rectangular Catalan and Narayana polynomials, and MacMahon polytope 
a. Define rectangular Catalan polynomial 

C(nMQ) = ^r4^ • (2.11) 

i=i j=i 

Show that 

m( 

q\ 2 Jc{n,m\q) = /C(„-),{inm)(g). (2.12) 

Thus, C{n,m\q) is a polynomial of degree nm{n — l)(m — l)/2 in the variable q with non- 
negative integer coefficients. Moreover, 



C{n, 2\q) = C{2, n\q) = c„(g) = 



2n 
n 
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coincides with "the most obvious" g-analog of the Catalan numbers, see e.g. |T^, p. 255, or 



66 



b. It follows from ( |2.12| ) that the rectangular Catalan number C{n,m\l) counts the 
number of lattice words 

w = aia2 ■ ■ ■ 

of weight (m"), i.e. lattice words in which each i between 1 and m occurs exactly n times. 
Let us recall that a word ai ■ ■ ■ Op in the symbols 1, . . . , m is said to be a lattice word, if for 
1 < r < p and 1 < j < m — 1, the number of occurrences of the symbol j in Oi ■ ■ ■ is not 
less than the number of occurrences of j ' + 1: 

#{i|l<i<r and = j} > < i < r and = j + 1}. (2.13) 

For any word w = Oi ■ ■ ■ a^, in which each is a positive integer, define the major index 



maj(i(7j 



fc-i 



and the number of descents 



i=l 



fe-1 



des(w) = > 



i=l 



Finally, for any integer k between and {n — l)(m — 1), define rectangular q-Narayana 
number 

N{n,m;k\q) = ^g'^^K'^)^ 

w 

where w ranges over all lattice words of weight (m") such that des(w) = k. 
Example 2.2 Take n = 4, m = 3, then 



^iV(3,4;fc|l)t^ 



1 + 22t + 113t^ + 190t^ + 113t^ + 22t^ + 



k=0 



This example shows that if n, m > 3, it is unlikely that there exists a simple combinatorial 
formula for the rectangular Narayana numbers iV(n, m; k\l), but see formula ( 2.14 ). 

• Show that 

i) C{n,m\q) = ^g'^^K"')^ ^here w ranges over all lattice words of weight (m"); 

1) — k\q) = N{m, n; k\q), for 



ii) N{n,m;k\q) = ^"'"{("-^H-iVs-'^) Ar(n, m; (n - l)(m 
any integer k, < A; < (n — l)(m — l)/2; 

== dimgV^^'^""'^'''^'*, for any integer k 



Hi) N{2,n;k\q) = g^'^'^+i) ^ ^ 



1 - 

gl{n-k+l) 
{k,k) 



n 




n 


k 


q 


k + 1 



< k < n — 1, where y^^'L" stands for the irreducible representation of the Lie algebra 
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g/(n— fc+1) corresponding to the two row partition (fc, k); recall that for any finite dimensional 
0/(A^)-module V the symbol dim^l^ denotes its g-dimension, i.e. the principal specialization 
of the character of the module V: 

dim,l^=(chV^)(l,g,...,g^-i); 

iv) iV(n,m; 1|1) = ^ ^ ^ |^ ^ ^ = ^ + "^ ^ - rim - 1; 



i>2 

v) (Fermionic formula for g-Narayana numbers 



mj{u^^^) 



(2.14) 



q \ 2 )N{n,m-l\q) = ^q^^''^ JJ 

M fcj>i 

summed over all sequences of partitions {u} = {z^^^-*, . . . , such that 

• = (m — fc)n, 1 < A; < m — 1; 

• = i'm — 1)?^ — I, i-e. the length of the first column of the diagram u^^^ is equal to 
(m — l)n — I; 

• Pf V) := - '^Qji'^^''^) + Qji^^''^^^) > 0, for all k,j > 1, 

where by definition we put u^^^ = (1"™); for any diagram A the number Qj{\) = A'^ + ■ ■ ■ A^- 
is equal to the number of cells in the first j columns of the diagram A, and mj{X) is equal to 
the number of parts of A of size j; 

k,j>l ^ ^ 

Conjecture 2.3 If 1 < k < {n - l)(m - l)/2, then 

N{n,m] k - 1|1) < N{n,m] k\l), 

i.e. the sequence of rectangular Naray ana numbers {N{n,m] k\l)}^i^^Q ^^™' is symmetric and 
unimodal. 



For definition of unimodal polynomials/sequences see e.g. where one may find a big 



variety of examples of unimodal sequences which frequently appear in Algebra, Combinatorics 
and Geometry. 

c. (Volume of the MacMahon polytope) Let dJlmn be the convex polytope in M""^ of all 
points X = {xij)i<i<n,i<j<m Satisfying the following conditions 

^ Xij ^ 1, Xij ^ Xi—ij^ Xij ^ Xjj' — i, (2.15) 

for all pairs of integers {i,j) such that 1 < i < n, 1 < j < m, and where by definition we set 
Xio = = XQj. 

We will call the polytope Tlnm by MacMahon polytope. The MacMahon polytope is an 

/ rji -\- 11 \ 

integral polytope of dimension nm with ( j vertices which correspond to the set of 



(0,l)-matrices satisfying ( p.l5|) . 
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If /c is a positive integer, define i{DJlnm', k) to be the number of points x G 9Jlnm such that 
/cx e Z"'". Thus, lidRnm] k) is equal to the number of plane partitions of rectangular shape 
(n™) with all parts do not exceed k. By a theorem of MacMahon (see e.g. Chapter 1, 
§5, Example 13) 



i=i j=i 



(an.^;fc) = nn ^^!^\ ^ - (2.16) 



It follows from ( |2.16| ) that the Ehrhart polynomial £{Mnm'-,t) of the MacMahon polytope 
9Jl„m is completely resolved into linear factors: 



n m 



t+i+j -I 



Hence, the normalized volume 

vol(OT„m) = (ram)!vol(97l„m) 

of the MacMahon poljd;ope 97l„m is equal to the rectangular Catalan number C{n,m\l), i.e. 
the number of standard Young tableaux of rectangular shape (n"*). We refer the reader to 
||66|| , Section 4.6, and [|25|, Chapter IX, for definition and basic properties of the Ehrhart 
polynomial SI"?; t) of a convex integral polytope 7. 
• Show that 

/ (n-l)(m-l) \ 

Y,i{mnm-^k)z^ = N{n,m-j)z^ /(I -^)"-+\ (2.17) 

k>0 \ j=Q j 

where 

N{n,m;j) := N{n,m; j\l) 
denotes the rectangular Narayana number. Thus, the sequence of Narayana numbers 

(1 = N{n, m; 0), N{n, m; 1), . . . , N{n, m; {n - l)(m - 1)) = 1) 



is the 6 -vector (see e.g. [^], §34) of the MacMahon polytope. In the case n = 2 (or m = 2) 
all these results may be found in [^], Chapter 6, Exercise 6.31. 

Questions, i) [Higher associahedron) Does there exist an (m — l)(n— l)-dimensional integral 
convex (simplicial?) polytope Qn,m which has /i-vector 

h = {ho{Qn,ni), hi{Q 

n,m)i ■ ■ ■ 1 ^(n— l)(m— 1) (Qrjjm) ) 

given by 

(n-l){m-l) 

HQn,m)q^'"'^^"'~'^~' = C{n, m\q) ? 

i=0 
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We refer the reader to |2^, Chapter I, §6 and Chapter III, for definitions and basic properties 
of the h-vectoT of a simphcial polytope; see also, R. Stanley (J. Pure and Appl. Algebra 71 
(1991), 319-331). 

ii) Define rectangular Schroder polynomial 



S{n,m\q) := C{n,m\l + q), 



and put 



S{n, m\q) 



(n-l)(m-l) 

J2 S{n,m\\k)q' 



k>0 



What is a combinatorial interpretation(s) of the numbers S{n,m\\k) and S{n,m\l)'! 

The answers on these questions are known if either n or m is equal to 2, see e.g. R. Simion 
(Adv. in Appl. Math. 18 (1997), 149-180, Example 4 (the Associahedron)). Note finally, 
that MacMahon's polytope and Narayana's numbers will appear again in Section |^, Exer- 
cise 3e. 

d. Denote by f{n, d) the number of ways to draw d diagonals in a convex (n + 2)-gon, 
such that no two diagonals intersect in their interior. 
i) Show that 



f{n,d) 



n 



n + d+l 
d + l 



n — d 
d 



-^({d+l)2,l"-'*-i),(l"+''+i)(l)- 



f2.18) 



For example, f{n,n — 1) is just the Catalan number 

1 



n 



2n 

n 



The first equality in the formula ( |2.18| ) goes back to T.K. Kirkman (1857), E. Prouhet (1866), 
and A. Cayley (1890); for precise references, see [0], p. 272. 

It follows from ( |2.18| ) that /(n, d) is equal to the number of standard Young tableaux of 
shape {{d + 1)^, 1""'^^^). It is natural to ask for a bijection between the polygon dissections 
and standard Young tableaux. Such a bijection was constructed by R. Stanley (J. Comb. 
Theory A, 76 (1996), 175-177). 

ii) Define a statistics h on the set -F(n, d) of d-tuples of non-crossing in their interior 
diagonals in a convex {n + 2)-gon such that 



/GF(n,d) 



2. Let /i be a composition, 
a. Show that 



n. 



n 

, . . . , jjj,fi 



(2.19) 
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Formula ( p.l9| ) goes back to C. Ehresmann who had computed (Ann. Math. 35 (1934), 
396-443) the Poincare polynomial of the partial flag variety JF^ corresponding to a composition 
H of n: 

fc>0 



/ii, . . . , /i„ 



b. (A generalization of the previous Exercise) Let R = {(/Ua")}i=i be a sequence of 
rectangular shape partitions, = Yla=i f^aVa- Show that 



N 



(2.20) 



'^KxRKx,{iN){q) = JJ A'(^2a) (i^„^,)(g) 

A a=l 

where Kxr denotes the value of parabolic Kostka polynomial KxR^q) at g = 1, see Section |, 



Definition |3.7| . In particular, if sequence 

R = {/ii, . . . l^'i, . . 
consists of only one row or one column partitions, and 



then 



N 



3. Define polynomial ^tfiil) to be the coefficient of Px in the product Sj^P^ 



s^{x)P^{x; q) = Y^ ipt^{q)Px{x; q). 



(2.21) 



(2.22) 



Equivalently, 



(g) = 5^K.,(g)/i(g), 



where for any three partitions X^iJi^v the polynomial f^^i^q) is the coefficient of Pa in the 



product Pfj,Pu, see e.g. IQ, Chapter III, §3. Recall that Pa, P^, . . . denote the Hall-Littlewood 
polynomials corresponding to partitions A,/i, . . .. 

Conjecture 2.4 For any three partitions A,/i, u the polynomial f'^^{q) is a polynomial with 
non-negative integer coefficients. 

For example: 



i>l 



K ~ K+i 



(2.23) 
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and therefore ffin-j^iq) = 0, unless A \ /i is a vertical n-strip, |]52|, Chapter III, (3.2), p. 215; 



\' — //' 

K - K 



i>0 ^ ^ 



(2.24) 



and therefore 



unless /i C A, |A \ yu| = ra, 0, ^ 



Perhaps, it is interesting to mention that if p is a prime number, then 

where for any partitions /i C A we denote by a\{fi;p) the number of subgroups of type /x in 
a finite abelian p-group of type A, see and for definitions and further details. 

a. Based on ( p.24| ), prove the following combinatorial/fermionic formula for the g-weight 
multiphcity Vxi,{q) := dimgV(^)(A): 



r-l 



k=l i>l 



(k+1) 



V, 



(k) 

i+l 
(k) _ ,,(fc) 
i+l 



(2.25) 



summed over all flags of partitions {u} = {0 = v^^^ C z^*-^-* C • • ■ C z/*-^'-* = A'}, such that 



yUi + ■ ■ ■ + /ifc, for all k, 1 < k < r = 



r-l 



EE 

fc=0 i>l 



{k+1) (fc) 



where A' denotes the conjugate of the partition A, see e.g. Chapter I, p. 2, and for any 
real number x we put 



:= x{x - 1)12. 



For a proof and applications of ( |2.25|) see 0, p6|| . 

Note also a preprint by G. Lusztig, Fermionic form and Betti numbers, [math. Q A/00050 10 



where a conjectural formula for the Betti numbers of a lagrangian quiver variety (see H. Naka- 
jima, Duke Math. J. 91 (1998), 515-560, for definitions), which generalizes the first equality 
in ( |2.25| ), is suggested. It seems a very challenging task to find for lagrangian quiver variety 
(constructed by H. Nakajima [ihid\ and G. Lusztig [ihid\) an analog of the second equality in 
(^. 

b. Consider the transition matrix 



M(e,P) := {M{e,P) 



which expresses the elementary symmetric polynomials ex (see e.g. Chapter I, §2) in 

terms of Hall-Littlewood polynomials: 

ex{X^) = J2M{e,P)x^P^.{X^;q). 
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It is well-known {[ibid\, Chapter III, §6) that 



• Use ( p.23| ) to derive the following combinatorial formula for the transition coefficients 
between the elementary symmetric and Hall-Littlewood polynomials: 



{jy} k=l i>l 



V. 



(fc+1) 



V. 



V, 



(k) 



— v. 



(fc+1) 
(fc+1) 

i+1 



summed over all flags of partitions {i/} := {0 = C z/*-^-* C 
yik) i^{k-i) jg ^ horizontal strip of length ^k, 1 < k < r = 
For a proof and applications of ( |2.26| ) see p6 |. 



C u 



(r) 



(2.26) 



A'} such that 



Remark 2.5 The specialization g = 1 in the both sides of formula ( p.26| ) gives rise to a 
combinatorial formula for the number of (0,l)-matrices with the prescribed row sums Aj and 
column sums ^j. The latter set (denoted by TZx^) has drawn considerable attention among the 
specialists in combinatorics and geometry, see e.g., survey articles by R.A. Brualdi (Linear 
Algebra Appl. 33 (1980), 159-231), and by G. Ziegler (in Polytopes-Combinatorics and 
Computations, G. Kalai and G. Ziegler (eds.), Birkhauser, 2000, 1-43). A problem of finding 
the precise number of matrices in the set TZx^ has been discussed frequently in the literature, 
see e.g., R.J. Ryser (Bull. Amer. Math. Soc. 66 (1960), 442-464). 

As far as I am aware, for the first time such a formula was obtained by B.Y. Wang 
(Scienta Sinica (Series A) 1 (1988), 1-6) and simplified later by B.Y. Wang and F. Zhang 
(Discr. Math. 187 (1998), 211-220). The formula for cardinality of the set TZx^ obtained 
by B.Y. Wang and F. Zhang, involves 2^~^ — n summations and (probably) does not have a 
natural g-analog which is compatible with the dual Knuth correspondence (see e.g., D. Knuth, 
Pacific J. Math. 34 (1970), 709-727) and the Lascoux-Schiitzenberger statistics charge, see 
e.g. ||52|, Chapter III, §6. It is unclear for the author are there some relations between the 
Wang-Zhang formula for the number |7^a/x| and that ( |2.26| ). Finally, note that yet another 
combinatorial formula for the cardinality of the set TZ\^ follows from Theorem 7.14 . 



4. (Generalized Rogers-Szego and modified Hall-Littlewood polynomials) 
a. The homogeneous Rogers-Szego polynomial Hiy{x,y; q) is defined by 



N 



HN{x,y;q) = ^ 



A:=0 



k 



x^y^^-K 



This polynomial can be viewed as a g-deformation of homogeneous Hermite polynomial 
HN{x,y). Let us recall the generating function for the Hermite polynomials 



N>0 
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see e.g., G. Andrews, R. Askey and R. Roy, Special Functions, Cambridge Univ. Press, New 
York, 1999, Chapter 6. 

• Show that generating function for the Rogers-Szego polynomials H]\r{x, y; q) is given by 



N>0 



{tx;q)oo{ty;q) CO 



(2.27) 



• Use ( p.27|) to derive the following recurrence relation for Rogers-Szego polynomials 

ifiv(x, y; q) = {x + y)HN-i{x, y; g) - (1 - q^'^)xyHN-2ix, y; q). 

b. More generally, follow [0], Chapter 3, Example 17, let us define the generalized Rogers- 
Szego polynomial 



HNiXn, q) 



E 



fci + ---+fc„=Af 

Use and (|CT| ) to derive that 



ki, . . . , kn 



■^1 -^n ■ 



(2.28) 



N 
2 



HN{Xn', q ) — <5(i]V)(A'„; q). 



Recall that X„ := (xi,...,x„) stands for the set of variables, and Q'^{Xn;q) denotes the 
modified Hall-Littlewood polynomial corresponding to partition fi. 

• Show that the generating function for generalized Rogers-Szego polynomials is given 

by 

E^^^^^-riTir^- (2.29) 



N>0 (^;^)^ 



\ itXj;q)c 



Based on (|2.29|) , deduce the following recurrence relation for generalized Rogers-Szego poly- 
nomials 

H^iX^-q) = y-(_i)fe-i ^j^-^ e,(X„)if^_,(X„; q), 

^ {q\q)N-k 

where efc(X„) stands for the elementary symmetric function of degree k in the variables X„. 
Perhaps, it is interesting to mention that the specialization 



-N{N-n 



)/2ng/ 



(1^) l-^l — !)•••; Xn 

X]^A,{i^)(g) dimV^ 



-N{N-n)/2n 



i;g) 



qKn) 



Ah AT 



is equal to the partition function for the so-called SU{n) Polychronakos-Frahm model, de- 
fined by the Hamiltonian 



HpF 



E 



jk 



^<j<k<N ^ ■> 
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where Pjk denotes the so-called exchange operator in su{n) spin space, and {tj} are the roots 
of the A^-th order (inhomogeneous) Hermite polynomial 

HNit) =y'^ Hn^x.v), t = x/y. 

For more details, see K. Hikami, J. Phys. Soc. Japan 64 (1995), 1047-1050, and the literature 
quoted therein. 



3 Parabolic Kostka polynomials 

Let Xn = {xi, ■ ■ ■ ,Xn) be the set of independent variables. For any sequence of integers 
7 = (7i,---,7n) put 

X'y — rr^'y^ ly'y'^ ... (t^t^ 

The symmetric group Sn acts on polynomials and rational functions in X„ = (xi, . . . , Xn) by 
permuting variables. 
Define operators 

JU) = (3.1) 
7r„(/) = J(l)-V(/), (3.2) 

where 

l<i<j<n 

is the Vandermond determinant, and 5 := 5„ = (n — 1, n — 2, . . . , 1, 0). 

Examples 3.1 1° For the dominant (i.e. weakly decreasing) integral weight A = (Ai > A2 > 
• • ■ > A„), the character chV^ of the irreducible highest weight A 0/(n)-module V\ is given 
by the Laurent polynomial 

sa(X„) = 7r„(x^) = chVA; 

when A is a partition (i.e. A„ > 0), sa(X„) is the Schur function, see e.g. Chapter I, §3. 
2° Let A = (Ai > A2 > ■ ■ ■ > A„ > 0) be a partition, then 



TTr. 



Ix^ n (1 - ^^^Z^^) ) = ^A(g)PA(X„; g). 



where P\{Xn]q) denotes the Hall-Littlewood polynomial, see e.g. |5^, Chapter III, §1, and 



i>0 
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Here A' = {X'l, ■ ■ ■ , A^) is the conjugate partition to A; by definition we set Ag = n, and 

m 

i=i 

Let rj = {rji, . . . ,T]p) be a composition of n. Denote by $(77) tlie set of ordered pairs 
(i, j) G sucli that 

l<i<rii + -- - + rir<j<n 
for some r, 1 < r < p. For example, if 77 = (1"), then 

<^{r]) = {ii,j)eZ^\l<i<j<n}. 

Let /i be a partition, /(/x) < n, and r/ be a composition, |?7| = n. Consider the formal 
power series 5^(X„; q), H^^{Xn] q) and Kx^r,{q) defined by 

B^{Xn;q) = n i^-q^i/^j)~\ (3-3) 

H^^{Xn;q) = 7rn{x^Br,{Xn,q)) (3.4) 
= (3.5) 

A 

where the sum runs over the set of dominant weights A = (Ai > ■ ■ ■ > A„) in Z". 

It is known that the coefficients Kx^n{q) are in fact polynomials in q with integer 
coefficients. If partitions A and /i, and a composition 77 such that /(/i) < |?7| are given, we 
will call the polynomial Kx^r,{,q) by parabolic Kostka polynomial of type {X^r]), or simply by 
parabolic Kostka polynomial if no confusion may happen. Note, that by the same formulae 
( p.3| )-( p75D the polynomials Kx^niq) may be defined also in the case when /x is a composition. 
However, in this general case polynomials Kx^niq) may have negative coefficients, and their 
combinatorial and representation theoretical meanings are unclear. 

Conjecture 3.2 (Kirillov-Shimozono [?D|) Let X, fi be partitions, \X\ = \fi\, l{fi) = n, and rj 
be a composition of n, then the coefficients Kx^r^iq) cire polynomials in q with non-negative 
integer coefficients. 

The partition /x and composition 77, /(/i) < |?7|, l{ri) = p, define a sequence of partitions 
R = . . . , /i'-^-'), /(/U*^*)) = r/j, by the following rule 

/^^'^ = (/^m+ -+'7.-i+i' ■ ■ ■ ' ^^m+-+v^)^ 1 < « < P, 
where by definition we put rjo := 0. 

Theorem 3.3 (|^2[) -^^f^^V be as above. Then 

Kx,,{l) = Muh[l^A : ®LiV;«], (3.6) 

i.e. Kxfini^) is equal to the multiplicity of irreducible highest weight X gl{n)-module Vx in the 
tensor product of irreducible highest weight /i*^*^ representations V^(i) , 1 < i < p, of the Lie 
algebra gl{n). 
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In the case when all partitions /i^*^ have rectangular shapes, Theorem p.3| has been proved 
in pi. 



Example 3.4 If r/ = (r/i, 772) £ ^>0) + ^2 = and is a partition, Z(yu) < ra, then 

^AM,(g) = g'^^'-^'^^Multil^A : V^d) ® V;,.)], (3.7) 
for some constant c(A, /x, 77) G Z>o, where /x^^-' = (/xi, . . . , /x,,J, iJp'^ = • • • , /Xn)- 



Remark 3.5 According to ( p.6| ) and Conjecture |3.2| , the parabolic Kostka polynomials 
Kx^rj{q) may be considered as a g-analog of the tensor product multiplicities. Another 
g-analog of the tensor product multiplicities had been introduced by Lascoux, Leclerc and 
Thibon Formula (|3.7| ) shows that in general these two g-analogs are different. However, 



it was conjectured in [^, Conjecture 5, and [0, Conjecture 6.5, that, in fact, these two 
g-analogs coincide in the case when partition fi and composition r] correspond to a dominant 
sequence of rectangular shape partitions. 



In the sequel, we are mainly interested in the case when for a given partition jj a com- 
position 7] is chosen in such a way that the corresponding sequence of partitions R = 
. . . contains only rectangular shape partitions, i.e. /x^"^ = (yU^") for all 1 < a < p. 

Conversely, any sequence R = {Ri,...,Rp) of rectangular shape partitions Ra = (/U^"), 
I < a < p, such that Hi > ■ ■ ■ > Hp (we will call such sequence dominant sequence of rect- 
angular shape partitions) defines the partition /x and composition 77. Namely, the parts of 
composition rj := rj{R) = {rji, . . . ,r]p) are equal to the lengths rja := l{Ra) of partitions Ra- 
The partition /i := /i(-R) is obtained by concatenating the parts of partitions Ra in order. 

Example 3.6 Take A = (5,4,4,2,1) and R = ((3, 3), (2, 2, 2), (2), (1, 1)). Then ri{R) = 
(2, 3, 1, 2) and /i(i?) = (3, 3, 2, 2, 2, 2, 1, 1). In this case 

^AMr,(g) =g'(l + 3g + 4g2 + 2g3). 



Definition 3.7 The parabolic Kostka polynomial K\^{q) corresponding to a partition A and 
a dominant sequence of rectangular shape partitions R is defined by the following formula 

Kxniq) = Kx^(R)r,iR){q)- (3.8) 

We will call the value of parabolic Kostka polynomial Kxf>{q) at g = 1 by parabolic Kostka 
number and denote it by 

KxR ■■= Kxnil). 



Theorem 3.8 (|^) Assume that X is a partition and R is a dominant sequence of rectangu- 
lar shape partitions. Then the parabolic Kostka polynomial Kxniq) non-negative integer 
coefficients. 
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Examples 3.9 Let A be a partition. 

1° Let Ra be the single row (/Xa) for all a, where /i = (/ii,/i2, . . .) is a partition of length 
at most n. Then 

Kxniq) = KxM)^ (3-9) 
i.e. KxR^q) coincides with the Kostka-Foulkes polynomial Kxfj_{q). 

Proof of ( p. 91) follows from the following, probably well-known, identity 

^n(x^ n (1- Wx,)-M =^e„(X„)-^Q;+(,„)(X„;g), (3.10) 

V i<i<j<n / k>0 

where e„(X„) = xi ■ ■ ■ Xn', Q^Xn, q) denotes the modified Hall-Littlewood polynomial cor- 
responding to partition z/, see e.g. [0. Recall that 



l-q 



^K^^{q)Sf,{Xr, 



See Remark |7.2CI| for yet another proof of the equality (|3.9| ) . 

2" Let Ra be the single column (1''") for all a, and 1] = (r/i, 772, • • •)• Then 

KxR{q) = Kx',A(l), (3.11) 

the cocharge Kostka-Foulkes polynomial, where A' is the conjugate of the partition A, and 
?7+ is the partition obtained by sorting the parts of 77 into weakly decreasing order. Formula 
( |3.11|) follows from that (|3.10|) and the duality theorem for parabolic Kostka polynomials. 



Duality Theorem ( ||35| , |40[| ) Let X be a partition, and R be a dominant sequence of rectangu- 
lar shape partitions, R = ((/i^"))^^;^. Denote by R' a dominant rearrangement of the sequence 
of rectangular shape partitions {{f]a''))a=i obtained by transposing each of the rectangular in 
R. Then 

KyR'iq)=q''^''^ Kxniq-'), (3-12) 
where n(R)= ^ min(/ia, /ib) min(?7a, r/t). 

l<a<b<p 



Note that the left hand side of ( p. 121 ) is computed in Ql{m), where m = ^/Xa is the total 



number of columns in the rectangles of R, whereas the right hand side of ( |3.12|) is computed 
in 5l{n), where n = ^?7a is the total number of rows in the rectangles of R. 

3° Let be a positive integer and -Ra be the rectangular with k columns and rja rows, 
|?7| = n. Then []70| , |6^ KxR{q) is the Poincare polynomial of the isotopic component of the 
irreducible GL(n)-module of highest weight (Ai — /c, A2 — fc, . . . , A„ — k) in the coordinate 
ring of the Zariski closure of the nilpotent conjugacy class whose Jordan form has diagonal 
block sizes given by the transpose of the partition 77"^. In the case 77 = (I"'), the polynomial 

KxR{q) = Y.q''^ 

{ei} 

gives the Kostant generalized exponents {cj} of representation Vx- 
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Exercises 

1. Let Tj = (?7i, . . . , rjn) be a composition, \rj\ = n. Show tliat 



TTr, 



n (1-9^./ 

(ij)G*{»y) 



where 



n 



denotes the g-multinomial coefficient. 
2. Take partitions A = {n + k,n,n — 
that if > fc, then 



2fc-l 





77 










and 


fi = X' = (77, 


77, ^ 
-1 > 


) + 



for some polynomial R{q) G N[g]. See also Section ^, Exercise 3e for a generalization of this 
result. 

3. i) Let A,/i, z/ be partitions, |z/| = |A| + |yu|, /(A) = p, < s. Consider partition 

A = (Ai + /ii, . . . , Ai + /is, Ai, A2, • • • , Ap) 

and a dominant rearrangement R of the sequence of rectangular shape partitions R = {u U 

(A?)}. 

• Show that 

where c^^^ denotes the Littlewood-Richardson number, i.e. 

c^^ = Muh[K : ® V;.], and gAi(//) = '''r 

i<Ai 

More generally, let A D /i be partitions such that the complement A \ yU is a disjoint union 
of partitions A'^^^ . . . , and l{fi) = m. Let u he a partition, define composition u = {fi, u) 
and partition 7/ = (777, l'^'). 

• Show that 



:= Muh[V; : V^m 



where 



n(u)-n{XW) r^(A(P))^ 



® Vxip) 



'-A(1),...,A(P) 

denotes the (multiple) Littlewood-Richardson coefficient, and c(A,/i, z/) G Z>o. 

It seems plausible that polynomial Kxi,r,{q) has non-negative integer coefficients (see Con- 
jecture 3.10 ), and the degree d{X, fi, z/) of parabolic Kostka polynomial Kxur]{q) is linear, i.e. 
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d{nX, nil, nv) = nd{\, fi, u) for any positive integer n (generalized saturation conjecture for 
multiple Littlewood-Ricliardson numbers). 

Note also, that the order of parts in the definition of composition z7 is very essential. 

See also Exercise 4 to Section ^ where connections between this Exercise and the so-called 
saturation conjecture are explained. 

ii) (Ribbon tableaux and parabolic Kostka polynomials) 

Let A D /i be partitions such that the complement A \ is a disjoint union of partitions 
A*^^\ . . . , A*-^-*, and /(/i) = m. It is well-known and goes back to D.E. Littlewood (Proc. R. 
Soc. A 209 (1951), 333-353) that there exists a unique partition A such that 

• p-core(A) = 0; 

• p-quotient(A) = (A*^^-*, . . . , A^-^^), see e.g. ||5^, Chapter I, Example 8. 



It follows from the very definition that 

|A|=p(|A«| + --- + |A(p)|). 
Now let z/ be a partition such that 

|zy| = |A«| + --- + |A(^)|, 
and Tab^^^(A, u) denotes the set of semistandard p-ribbon tableaux of shape A and weight u, 



see e.g. [Q, Section 4, or |£2|, Chapter I, Section 8, Example 8. 

Finally, define composition u = (/i, z/) and partition i] = (m, l''^!), and consider the set 
LR{X,u,ri) of Littlewood-Richardson's tableaux of shape A and type (z^, //), see e.g. |41[] , 
Section 2. 

• Based on the Stanton-White method (D. Stanton and D. White, J. Comb. Theory A 
40 (1985), 211-247) construct a bijection 

7T : Tab(P)(A,z/) ^ LR{X,u,7]). 

In particular, 

K,~,,{1) = |Tab(^)(A,z.)| = 6,(A)ir^^^^e---®z//Cp), 

p 

where (p = exp(27rz/p) and ep(A) = ±1. The second equality is due to A. Lascoux, B. Leclerc 
and J.-Y. Thibon (C.R. Acad. Sci. Paris 316 (1993), 1-6). 

Now follow Section 5, denote by spin(T) the spin of a ribbon tableau T. Recall that 
the spin of a ribbon tableau T is by definition the sum of the spins of its ribbons; the spin of 
a ribbon R is by definition {h{R) — l)/2, where h{R) denotes the height of R; the height of 
a ribbon is defined to be one less than the number of rows it occupies. 

Finally, define the {q, t)-ribbon polynomial 

<(.,...,A(.)(?,^)= E t--(^)g^W^)), 

where 

c(7r(r)):=c(7r(T))-rf(A,^,z/). 
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From the very definition polynomials c^(i) t) have the following properties 

• c5;(i),...,A(P)(?.^) 

.c;;(,)_,(,)(l,l) = |Tab(^)(A,z/)|; 

Conjecture 3.10 Bijection it may be constructed in such a way that 

• CA(i),...,A(f)(^'l) = K^^^il)'' 

• '^A(i),...,A(p)(^' ^ '^A(i),..,A(p)(^)' 

where c^(i) (t) denotes the t-deformation of multiple Littlewood-Richardson numbers in- 
troduced by A. Lascoux, B. Leclerc and J.-Y. Thibon (see e.g., B. Leclerc and J.-Y. Thibon, 
Littlewood-Richardson coefficients and Kazhdan-Lusztig polynomials, |math.QA/9809122| , 
52p.). 

4. a. Let n > 1 be an integer, consider staircase partition 

6n = {n,n - 1, ... ,2,1) 
and partitions yU„ = (5n-i, 1*^), and //„ = (ra — 1, 1"). Show that 

b. Let n > 2 be an integer. 

i) Consider staircase partition 5„ = {n,n — 1, ... ,2,1) and partitions /i„ = (5n-2, 1^"""^), 
and r]n= {n — 2, 1^"^^). Show that 



Equivalent ly, 

EKs a n (1)^— rT=tanX. 
On,fJ-n,Vn\ I ( \\\ 



n>l 



Hence, the number of standard Young tableaux of skew shape 5„ \ 5„_2 is equal to the tangent 
number 

_ 2^"(2^"-l) ,^ 

-Ln ■— -D2„ . 

2n 

Here and further B„ denotes the n-th Bernoulli number. Recall, that 



Ex 
Bn—r 



X 



n\ exp X 

n>0 ^ 



ii) Show that the Kostka-Foulkes polynomial -ft'sn,^^, »?„('?) is divisible by the product 



n-l 



+ q'), and the ratio is a polynomial with non-negative integer coefficients. 
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iii) Show that the number of semistandard Young tableaux of skew shape 5„ \ Sn-2 and 
weight (2"-\ 1) is equal to 2-("-i)T„. 

iv) Show that the number of semistandard Young tableaux of weight (2"~^) and skew 
shape 5„ \ (n — 1, n — 3, . . . , 2, 1) is equal to 2"~^|G2n-2|, where denotes the n-th Genocci 
number. Recall that 

Gn—r = = x(l — tanh -). 

n\ 1 + expx ^ 2^ 

n=l 

It is easy to see that 

|G2n| =2(22"-l)|£2n|, Gsn+l = 0, if n > 0. 

v) Consider partitions an — (n, n — 1, . . . , 3, 2), /3„ = {Sn-2: and 7„ = {n — 2, 
Show that 

^a„,l3n,ln{^) = \E2n-2\- 

Equivalently, 

^2n-2 



n>l ^ ^' 



Hence, the number of standard Young tableaux of skew shape (n, n — 1, . . . , 3, 2) \ Sn-2 is 
equal to the secant (or Euler) number \E2n-2\- 

Here E2n denotes the n-th Euler number. Recall that 

^2n 

n>0 ^ ^ 

Formulae for the numbers Ks^,n„,r)„{i) from the items i) and v) of Exercise 4b are well- 
known, see e.g. H.O. Foulkes (Discr. Math. 15 (1976), 235-252), or I. Gessel and G. Viennot 
(Adv. Math. 58 (1985), 300-321). 

c. i) Denote by An the set of alternating (or zigzag) permutations of n letters, i.e. 

A — i X r. I 02i-l < 0,21, i = 1, . . . , [|] , 

>^n — S {U'l: ■ ■ ■ : "nj t 0„| ^- _ 1 ["-11 

a2i > a2i+i, ^ — 1, . . . , [-2~J ■ 
Show that 

EX^ 
\An\—r ~ tanx + secx. 

n>0 

This result is due to D. Andre (J. Math. Pures Appl. 7 (1881), 167-184). 
ii) Denote by Sn the set of permutations w — W1W2 ■ ■ - Wn £ Sn satisfying the following 
conditions 

• if n = 2k, then i and i + 1 must precede i-|-/cforl<i<A; — 1, while k must precede 

2k; 

• if n = 2A; -I- 1, then i and i + 1 must precede i + k + 1 ior 1 < i < k. 
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Show that 



X 

E\Sn\—r — tanx + 1 
n I 



n>l 



sec X. 



This result is due to R. Stanley (Ann. Discr. Math. 6 (1980), 333-342). 

iii) Construct bijection between the set of alternating permutations An and that of Sn- 

d. Let Vn be a convex integral polytope in determined by the following inequalities 

• Xi > 0, 1 < i < n, 

• Xi + Xi^i <l,l<i<n — 1. 

i) Show that the number of vertices of the polytope Vn is equal to the (n-|- l)-th Fibonacci 
number Fn+i- 

Recall that Fibonacci's numbers Fk may be defined using the generating function 

k>0 

Question. What are the numbers fi{Vn): < i < n — 1, of i-dimensional faces of the 
polytope VJ 

ii) Let ipn denotes the volume of the polytope Vn- Show that 

ipnx" — tan X + sec x. 

n>0 

This Exercise was proposed by R. Stanley (Amer. Math. Monthly 85 (1978), p. 197, 
Problem E2701). For the solution to this problem given by LG. Macdonald and R.B. Nelsen 
(independently), see Amer. Math. Monthly 86 (1979), p.396. 

iii) Let 

S{Vn)-{St\s^'\...,S^:l,) 
denotes the (5-vector of the polytope Vn, i-e. 

Y,^{rn,k)t'- (j2^^^¥) /(i-^rs 

fe>0 \fc=0 / 

where i{Vn', k) denotes the number of points a & Vn such that ka e Z". 

• Show that 

0„ - 0„_i - 0, - ()„_2 - 1, (Ji - C)n-3 - ^n+l - U - 

n 

<5(P„; i) = ^ = ^t'i-(-). 

fc=0 W&Sn 

• Show that 5{Vn',t) is a symmetric polynomial (in the variable t). 
Conjecture 3.11 The S{Vn',t) is a unimodal polynomial. 
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/ 27ii \ 

e. i) Let q = exp I — J be primitive root of unity. For each integer m between 

and k, let Vm denote the (2m + 1) -dimensional irreducible representation of the quantum 
universal enveloping algebra Ug{sl{2)). Show that 



^(P„;A;)=Mult h/r^l : F^'^ 



^(g)(n+2) 

£+ 
2 



i.e. the number of integer points i(Vn', k) of the convex integral polytope kVn is equal to 
the multiplicity of the irreducible representation Vj^fc+ij of the quantum universal enveloping 

algebra f/g(s/(2)) with 



q = exp 



2iri 



2k + 3^ 

in the [n + 2)-th restricted tensor power of the representation Vrfc+ii. We refer the reader to 



27|1 , Chapter 13, Exercise 13.34, for definition and basic properties of the restricted tensor 
products. 

ii) Denote by A/^ = {aij) the {k + 1) by {k + 1) integer matrix with the following matrix 
elements: 

1, ifi+j>A; + 2; 
0, i <k + 2. 



• Show that 

i.e. the number of integer points of the convex integral polytope kVn is equal to the {k 
l,k + l)-entry of the {n + l)-th power of the matrix Ak- 

• Show that 

Al = (min(ii,j))i<ij<fc+i, 

and the characteristic polynomial 

Dk{t) ■.= det{tIk+i-Al), 

where Ik+i is the identity matrix of order k + 1, satisfies the recurrence relation 

Dkit) = {l-2t)Dk-i{t)-t^Dk-2it), if k>2, 
Do{t) = 1-t, = 1 -3t + tl 

• Show that the roots ta of the characteristic polynomial Dk{t) are given by 

1 2 '^^ 
'" = 4^^^ 2^' 1<«<^ + 1- 

• Show that 

= (%)i<jj<fc+i, 
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where 



-1, if^-jl 



0, if|i-j|>2. 

All statements of Exercise e, ii) may be considered as well-known, but we are not able to 
find precise references where these statements were formulated for the first time. 

iii) Let Zn denotes the n-element "zigzag poset" with elements {xi,...,x„} and cover 
relations X2i-i < X2i and X2i > X2i+i- 

• Show that 

i(Vn+i; k) = Vt{Zn] k), 

where k) denotes the order polynomial of the poset Z„. We refer the reader to a book 

by R. Stanley vol.1, Section 3.11, p. 130, for a definition of the order polynomial of a 
finite poset. 

iv) Follow [^, vol.1. Section 3, p. 157, consider the generating function 



n.>0 



Show that 



= 1/(1 — x) and G 



k+l 



1 + Gkjx) 
3 — — Gk{x) 



if k>l. 



This result is due to G. Ziegler, see e.g. [§6|, vol.1. Chapter 3, Exercise 23 d. The generating 
function Gk{x) was computed for the first time by R. Stanley (Ann. Discr. Math. 6 (1980), 
333-342, Example 3.2). 

Problem 3.12 Compute the two variables generating function 

G{x,t) = J2 i{Vn]k)xH''. 

n,k>0 

v) Show that the number of integral points i('P„; k) of the polytope kVn is equal to the 
number of n-step paths when light ray is refiected from {k + 1) glass plates (the so-called 
multiple reflections or wave sequences). 

Further details and references to the Exercise e, v), may be found in 

• L. Moser and M. Wyman, The Fibonacci Quarterly 11 (1973), 302-306; 

• B. Junge and V. Hoggatt Jr., The Fibonacci Quarterly 11 (1973), 285-291; 

• G. Kreweras, Math. Sci. Hum. 14 (1976), n053, 5-30; 

• J. Herman and P. Kohler, Mitt. Math. Sem. Giessen 121 (1976), 103-124; 
and the literature quoted therein. 

Remark 3.13 (Fermionic formula for the numbers i{Vn', k)) Consider partitions 



A 



A 



(n,fc) 



n + 3) 
k + l 



k + l 



(n + l) 



k + l 



k + l 



\ 



n+2 
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and set / = 2fc + 1. It follows from part i) that i{Vn', k) is equal to the /-restricted Kostka 



number K^j^. 



For the reader's convenience, let us recall Il33| a fermionic formula for the /-restricted 
(0/ 



Kostka polynomial Kfj^{q) in the case of two row partition A = (Ai > A2 > 0) and the same 
size partition /i: 



summed over all partitions = (z^i > > ■ ■ ■ > 0) such that 

• |z/| = Z/i + Z/2 H = A2, 1^1 < /, 

• Pjiiv] yu) := Xla /^a) - max(j + Ai - A2 - /, 0) - 2Qj(z/) > for all j > 1. 
Here and further we are using the following notation: Qjiv) := Ylik<j ^ji^ 

and n{u) = Y.i>ii^ - 

Thus, we come to a fermionic formula, 



(3.13) 



ly'-iy' 



i(P„;A;)=i^,,„,„^^„,,(l) = J]n( 

u 7>1 ^ 



mj{iy) 



(3.14) 



summed over all partitions = (z^i > 2^2 > ■ ■ ■ > 0) such that 

I k + ll 

• \u\ = + 1^2 -\ = (n + 1) — - — , ui <2k + 1, 

• Pj{u) := (n + 2) min(j, 2 [^] ) - max(j - 2 [|] - 1, 0) - 2Qj{u) > for all j > 1. 

In particular, if = 1 the formula (|3.14|) gives a "fermionic expression" for Fibonacci's 
numbers. 



vi) Show that 



K^n;fc) = 5]n( 

u j>l ^ 



summed over all partitions v = (z/i, z/2, . . .) such that 

• I'l < k; 

• Pj{u; n) := (n + l)j - 2Qj{v) > for all j > 1, 

where as before mj{u) = Uj — i^'j+i, and Qjii') = ^^min(j, Ua). 
More generally, denote by Vn\r, s) the convex polytope 



{x = (xi, . . . , Xn) G M>Q|a; G kVn, Xi < r, Xn < s}. 



Show that 



(r.sjnz- 



V i>l 



Pj{v\ n, r, s) + mj{v) 



summed over all partitions z/ = (z/i, z/2, . . .) such that 
• z/i < /c; 



(3.15) 



(3.16) 
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• Pj(z/; n, r, s) := {n — l)j + min(j, r) + min(j, s) — 2Qj{i') > for all j > 1. 

Note that the RHS (|3.14| ) and the RHS (|3.15|) have a different combinatorial structure, but 
count the same number (= i{Vn',k)). This observation gives rise to an interesting combi- 
natorial identity: RHS ( P • 141) =RHS ( p. 15|) . It will be interesting to find a direct combinato- 
rial/bijective proof of the latter. 

vii) Consider matrix M := Mk{x) of size k + 1 hj k + 1 with entries 



0, ifi+j<k + 2; 



For each integer r between and k, define the column vector 

r 

|r) = er+i + ■■■ + Cfc+i = (0, . . . , 0, 1, . . . , IJ* G Matix(fe+i)(Z). 

^^"^^^^^^^^"^ ^^^^^^^^^^ 



V— 

fc+1 



Consider the following product of matrices 

M(g^-V) . . . M{qx)M{x)\r) := (ag^^(x; g), . . . , ^^^^(x; g))*. 
• Show that for each integer s between and /c, one has 



u j=l >- 



Pj(z/; r, s) + mj{iy) 



mj[i') 



-I 9 



summed over all partitions z/ = (z/i, z/2, . . .) such that 
• z^i < fc; 

(A^ — l)j + min(j, r) + min(j, s) — 2Qj{v) > for all j > 1; 

Qji^) = Eamin(j,z/a). 



Show that 

r,k,N^ 



a 



x;q) 



E 



(fei,...,bjv)GP^'){r,s) 



(3.17) 



(3.18) 



As far as I am aware, the product of matrices 

M,{q''-'x)...Mk{qx)Mk{x)\r) 

was invented by B. Feigin (private communication, 1992) as a tool for obtaining a fermionic 
formula for the level k vacuum representation of the affine Lie algebra s/2, and that for 
the characters of certain unitary representations of the Virasoro algebra. This product of 
matrices was studied further by E. Frenkel and A. Szenes (Int. Math. Res. Notices 2 (1993), 
53-60) and by A.N. Kirillov Fusion algebra and Verlinde formula, Preprint of Isaac Newton 
Institute IN-92019, and |hep-th/9212084| . To our knowledge, the fermionic formula ( |3.17| ) for 



polynomials a^^l fyf{x; q) was obtained for the first time in ||3^, p. 99. 
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f. Consider the sets 



j}, and 5« = U S^^^\ 



je[i,n] 



Show that 





t'^^<''\ and = { 



u = wn\w e (Sn-i}; 



iii) if n = 2fc + 1, A; > 1, then 




^ ^ ^n— 2— des(ti) 

,(fc+2-i,3fc+3-j) 



Let us denote by S* the set of all permutations w — Wi - ■ -Wn such that the permutation 
w — l{wi + !)••• {wn + 1) belongs to the set Sn+i- It follows from part i) that 15*1 = l^^l- 

Example 3.14 Consider the case n = 5. Then 



A5 = {13254, 14253, 14352, 15243, 15342, 23154, 24153, 24351, 25143, 25341, 

34152, 34251, 35142, 35241, 45132, 45231}; 
^5 = {12345, 12354, 12435, 13245, 13254, 21345, 21435, 21354, 23145, 23154, 

23514, 31245, 31254, 32514, 32154, 32145}; 
S* = {12345, 12435, 12354, 12453, 13245, 12543, 12534, 13254, 21354, 21345, 

21435, 21453, 21543, 21534, 25134, 25143}. 

Hence, 6{V5; t) ^ 1 + 7t + Yt"^ + t^; 

J2 ^des{^)^maj«; ^ ^ ^^3^ + 2q^ + 2q^ + Q^) + t\q^ + 2q* + 2q^ + 2q^) + t^q'^; 



For the reader's convenience, we list below (for n — 5) some classes of permutations 
w ^ Sn which arc equinumerous to the set of alternating permutations An'- 

• augmented Andre permutations of the first kind (see e.g., M. Purtill, Trans. ^M^S" 338 
(1993), 77-104, and the literature quoted therein) 



Ai = (12345, 12435, 13425, 23415, 13245, 14235, 34125, 24135, 23145, 21345, 
41235, 31245, 21435, 32415, 41325, 31425}; 



^5 := VOl(7'5) 



2^(2^ - 1) 




6! 
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• Andre permutations of the second kind (D. Foata and M.-P. Schiitzenberger, in A survey 
of Combinatorial Theory, J.N. Srivastava et al. eds., Amsterdam, 1973, 173-187) 

Al^ = {12345, 12534, 14523, 34512, 15234, 14235, 34125, 45123, 35124, 51234, 
41235, 31245, 51423, 53412, 41523, 31524}; 

• augmented simsun permutations (see e.g., R. Stanley, Math. Z. 216 (1994), p. 498) 

SS5 = {12345, 12435, 13245, 13425, 14235, 21345, 21435, 23145, 23415, 24135, 
31425, 31245, 34125, 41235, 41325, 42315}; 

• Jacobi permutations (G. Viennot, Journ. Comb. Th. A 29 (1980), p. 124, Definition 3) 

J5 = {15432, 35421, 52431, 42531, 32541, 54132, 53142, 13542, 43152, 52143, 
15243, 42153, 14253, 32154, 13254, 15432}. 

It looks very challenging to construct bijections between the sets An, A^, A^ , Sn, S*, 
SSn and J„. 

g. Let n > 2, denotes by Vn the convex (rational) polytope in determined by the 
following inequalities 

• Xi > 0, 1 < i < n, 

• Xi + Xj+i <1, l<i<n — 1, 

• Xi + x„ < 1. 

Show that ^ 

vol(P„)x""^ = -(tanz + sec x), 

n>l 

i.e. _ 

• vol(P2fe.i) = 2vol(P2fe), iik>l, 

• vol(P2fe) = 2vol(P2fc+i), if A; > 0, 
where by definition we set Vi := [0, 1/2]. 

5. Let us fix n > 3. i) Consider partitions A„ = (n + 1, n, . . . , 4, 3), /x„ = [n ~ 2,n — 
3, . . . , 2, l3"-3), and r]^ = {n - 2, l^"-^)^ g^ow that 

(3n- 3)1(2^-^-2) 

J^Xnf^„r,A^> - - 2)! l^2n-2|, (3.19) 

and thus, the number in the RHS( |3.lD| ) is equal to the number of standard (skew) Young 
tableaux of shape (n + 1, n, . . . , 3) \ (n — 2, n — 3, . . . , 1). This result is due to I. Gessel and 
G. Viennot |16], §11, and A.N. Kirillov [37|. It has been shown in that 



(3<7)!det 



(3-2z + 2j)! 



Mg^|52,| = (3,)!vol(Ar,+0, 
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where vol(Ag) stands for the volume of the moduh space Mg of stable rank 2 vector bundles 
over a smooth complex curve of genus g. 

ii) Consider partitions A„ = (n + 1, n, . . . , 4, 3, 2, 1), 
/i„ = (n - 2,n - 3, . . . , 2, l^"), and ri^ = {n - 2, l^"). Show that 



2n\ 



(3.20) 



6. Let m,n > 2 and > n be integers. Consider partitions Xn = N{n, n — 1, . . . , 2, 1) + 
(m, 0, . . . , 0), fijy = N{n, n — 1, . . . , 2, 1) + (0, . . . , 0, m), and a composition i] = (1, n — 2, 1). 



n-l 



Show that if m > ri — 1, then 



K 



Ajv,Aijv,r) 



m / 

fe) = E( 



n - 2 + A; 
A; 



fc+m 



7. Let a and /3 be partitions, and n, s be integer numbers such that s > Define 
m := s — \l3\ > 0, and consider partition 

A := [a,p]s = {ai + s,. . . ,ap + s,s^^^^^,s - pt, ■ ■ .,s- Pi), 

n—p—t 

where p = l{a), t = 1{P), and the dominant sequence of partitions 

^:=K'^ = {(l),---,(l),(l"-^),---,(l"-^)}, 



where r := |a| — \P\ + s. Let us introduce notation Sm '■= Rm'"^, and assume additionally 
that n>m + l{a) + 1{P). 
i) Show that 



KxR{q) = 



• 


r 




s 




m 


q 


m 



^a,(ll-l)(?)^/3,(ll/3|)(?)^( 



(3.21) 



ii) Show that 



[1] = m!, 



and Kxr{1) is equal to the number ci"s^' of up-down staircase tableaux of shape 
{a, P}n := (ai, . . . , Op-i, a^, 0, . . . , 0, -Pt, . . . , -Pi) 



n—p—t 



and type e^^s :=(!,..., 1, —1, . . . , —1), see Definition 4.4. In particular, the number a. 



"23 



of alternating (or oscillating) tableaux, i.e. up-down staircase tableaux of shape {a,P}n and 
type e = (1, —1, 1, —1, . . . , 1, —1), [ihicl\, is equal to 



2s 



(.-|a|)! 



s 

\a\ 



rf, if n>s-\a\ + lia) + lip). 
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Formulae for the numbers c^^f^ and due to J. Stembridge |]6^, Proposition 4.8, and 

in some particular cases to P. Hanlon |2^. Formula ( p.21|) may be considered as a g-analog 
of the above results obtained by J. Stembridge. 

Examples 3.15 1° Take a = /? = (2, 2) and n = s = 6. Then A := [a, (3]^ = (8, 8, 6, 6, 4, 4), 



m 



2, and R := RI'*^ = {(1), . . . , (1), (1^), . . . , (1^)}. Using the fermionic formula Q, one 



can check that 



6 
2 



Ka,(ii){q) = q^ + q^ = ^(22),S2(?)- 



2° Take a = /? = (2, 1), n = 7, and r = s = 6. Then A := [a, [3]^ = (8, 7, 6, 6, 6, 5, 4), m = 3, 
and R := R^'^ = {(1), . . . , (1), (1^), . . . , (1^)}- Using the fermionic formula ( [4.1|) , one can 

check that 



6 



K^Riq)=q''{l + q) 



6 
3 



:i + g2 + 2g3 + g4^g6)^ 



K(2,i),ii3){q) =q + q^, 

Ki333),sM = q\l + q' + 2q' + q' + q')- 



iii) Show that if r > |a|, s > |/?|, and r — s 



\a\ 



then 



(g) (3.22) 

for all n > l{a) + and if n > s - \/3\ + l{a) + then the LHS (|02D is equal to the 
RHS(^:22D. 



Example 3.16 Take a = P = {2, 1), and r = s = 6. Using the fermionic formula (|4.1| ), one 
can check that 



- = ^''^^ + q + q' + q' + q 

Questions, i) Let A be a partition and R = {Ra = (/^a")}L=i be a dominant sequence 
of rectangular shape partitions. Under what conditions on A and R the parabolic Kostka 
number Kxr 7^ ? 

One obvious necessary condition is the following: A > yu(-R) with respect to the dominance 
ordering on the set of partitions. Let us recall, see Section ^, that fi{R) denotes the partition 
which is obtained by concatenating the parts of partitions Ra in order. 

ii) When does the parabolic Kostka number i^A.R equal to 1? 
For example, 

K(8n,8n,8n,8n,8n),i(5n,5n),{5n,5n),{5n,5n),{5n,5n)){q) = <? 

iii) Does there exist an explicit formula for computing the degree of parabolic Kostka 
polynomial KxR^q) ? Recall that deg Kx^{q) = n{fj,) — n(A), see e.g. |5^, Chapter I. It looks 
plausible that the degree d{X, fi; rj) of parabolic Kostka polynomial K\fj_rj{q) is a homogeneous 
degree 1 function, i.e. d{nX, rifi; rj) = nd{X, fi; rj) for any positive integer n. 
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Example 3.17 Below we list some "exotic examples" of Kostka-Foulkes and parabolic 
Kostka polynomials: 



(42), (2 



(442), (3,3, 2,1,1) 



,l4)(g) 
1,1)(?) 



-^(4422), (3,3, (2, 2), 1,1) 

(?) 



(4431), (3, (2, 2), (2, 2), 1) 



-f^(444222),(3,(3,3),(2,2,2),2,l) (?) 
-f^(664),((3,3),(3,3),2,2)(?) 
-f^(654321),(4,(3,3,3),(2,2),(l,l,l,l)) (?) 

(?) 



(7654321), ((4,4,4), (3,3,3,3),2, (1,1)) 



(7654321), ((4,4,4,4),4,2, (1,1), (1,1, 1,1)) 



(?) 

-^(87654321), (5, (4,4,4,4), (3,3,3), (1,1,1,1,1),1) (?) 
^ (2n,2n,2n,2n),((n,n),(n,n),(n,n),(n,n)) (?) 



?'(11211), 
?'(11311), 
?'(11411), 
2?'(111), 
?'(2332), 
?'(21211), 
3q%l + q)', 
3g^(l + gr, 
g«(5,17,24,17,5), 
6?''(l + ?)^(2 + 3g + 2g2) 
n + 2 



? 



An 



More generally, let us take A = (2n, . . . , 2n), and R = ((n'^), (n^), {n^ 

2k 



{n'')). Then 



Indeed, there are exactly 



n + k 



n + k 
k 



(3.23) 



admissible configurations of type {X;R), each of those 



has zero essential vacancy numbers only. Similarly, let n > m > and A; > 1 be integers, 
consider partition A = (2n, . . . , 2n, 2m, . . . , 2m) and sequence of rectangular shape partitions 

2k 2k 

R = (((m + nf), ((m + n)^), ((m + n)''), ((m + n)'')). 

Then 



k + n — m 
k 



(g)=gi3(25652) = S2i(l,g,g,g'). 
See also Section |^, Exercise 14 for a generalization of the latter example. 



(9621), ((3,3), (3,3),3,3) 



4 Fermionic formula for parabolic Kostka polynomials 

Let A be a partition and R = ((/xJJ"))a=i be a sequence of rectangular shape partitions such 
that 

|A| = ^ \Ra\ = y^^HaTJa. 
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Definition 4.1 The configuration of type (A; R) is a sequence of partitions v = z/*-^-*, . . .) 
such that 



^ - Ha Txiax{r]a - k,0) = - ^Xj + '^Ha min{k, r]a) 

jyk a>l j<k a>l 



for each k > 1. 



Note that ii k > /(A) and k > rja for all a, then z/'^'^^ is empty. In the sequel (except 
Corollary [4.4|) we make the convention that z/(°) is the empty partition. 

For a partition /i define the number = fi'i + ■ — h /ij^, which is equal to the number 

of cells in the first n columns of fi. The vacancy numbers Pn\i') '■= Pn\i''iR) of the 
configuration z/ of type (A; R) are defined by 

H^) = Qn(//('-'^) - 2g„(z/('=)) + g„(z.('=+^)) + 5^min(/i„,n)5,,,fc 

a>l 

for k,n> 1, where is the Kronecker delta. 

Definition 4.2 T/ie configuration v of type (A; fZ) zs called admissible, if 

Pi'"\iy;R) > for all k,n>l. 

We denote by C(A; iZ) the set of all admissible configurations of type (A; R), and call the 
vacancy number P^\v\ R) essential, if m„(z/*^^)) > 0. 

Finally, for configuration v of type (A; R) let us define its charge 



c\y) = 

k,n>l 



2 



(fc-i) (fc) 
an - an 



and cocharge 

fc,n>l 

where ai*^^ = (z^*^^-*)^ denotes the size of the ra-th column of the fc-th partition u^'^^ of the 
configuration u; for any real number x G M we put 6{x) = 1, if a; > 0, and 6{x) = 0, if a; < 0. 

Theorem 4.3 (Fermionic formula for parabolic Kostka polynomials ^) 

Let X be a partition and R be a dominant sequence of rectangular shape partitions. Then 



fc,n>l 



p!i'\u- iZ)+m„(z/('^)^ 
mn(z/('')) 



(4.1) 



summed over all admissible configurations v of type {X;R); m„(A) denotes the number of 
parts of the partition X of size n. 
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Corollary 4.4 (Fermionic formula for Kostka-Foulkes polynomials |^) Let A and yU be 

partitions of the same size. Then 



u k,n>l 



Pi'^Hz/,/i)+m„(z/W^ 



(4.2) 



summed over all sequences of partitions v = {z^*-^-*, i^*-^-*, . . .} such that 



{k)\ 



Yl,j>k ^ — 1,2,.. .; 



• P^''\u,^) := (5„(z/(''"^))-2g„(z/('=)) + Q„(z/('=+i)) >0/or allk,n>l, whereby definition 
we put u^'^^ = n; 



civ 



k,n>l 



2 



(4.3) 



Exercises 
1. Show that 



E^*' n 



k,n>l 



pfV; P) + m„(z/«; 

m„(z/*^^)) 



0, 



(4.4) 



where the sum is taken over the set of all non-admissible configurations of type (A;i?), i.e. 
configurations v of type (A; R) such that 

for some /c, n > 1. Here, for any integer N and non-negative integer M we use the notation 
to denote the modified g-binomial coefficient 

9 



M 



N 
M 



l-g^)(l-g^-^)---(l-g 
(l-g)(l-g2)...(i-g 



2. (KOH's identity) Follow |7T|], denote by G{n., k) the g-binomial coefficient 

that G{n, k) = 0, if either n < or A; < 0). 
Show that 



n + k 
k 



so 



-I q 



Gin, k) = J2 n ^((^ + 2)J - 2^ + - ^■)^'' ^^•)' 

summed over all partitions u = (f^^ 2^^^, . . . , /c'^'=) of k; 

2n{v) = jc^l + 2 y~]min(i, j)(ij(jj — /c. 
j>i i<j 



(4.5) 
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Binomial identity ( |4.5| ) is due to Zeilberger and may be considered as an algebraic version 



of the main result, Theorem 2.13, of K. O'Hara's paper ||5^. Note that if one replaces in 
the identity ( [4. 51 ) the g-binomial coefficient G{n, k) by the modified g-binomial coefficient 
n + k 



see definition in the previous Exercise 1, then this new version of the identity (|4.5| ) 



k 

becomes "much more elementary", and a short algebraic proof of it was found by Macdonald 



Remark 4.5 Binomial identity ( |4.5| ) is a particular case of the identity (|TT 
N = k + n and A = (l'^). Note that the symmetry relation 



in the case 



n + k 




n + k 


k 




n 



gives rise to a highly nontrivial identity between binomial sums. 



Problem 4.6 Let A and /i he partitions, l{fi) < n, and t] be a composition of n. Find a 
fermionic formula for the parabolic Kostka polynomial K\^j_,^{q) which generalizes that ^4 -A )- 



3. (Domino tableaux and configurations) 

i) Let A and /i be partitions such that Z(yu) = s, and C(A;/i) be the corresponding set 

of admissible configurations. Denote by C(2)(A;/i) the subset of C(A;/i) consisting of all 
configurations v such that 

Pi^\v)mn{y^^^) = O(mod 2) for all n,k>l. (4.6) 

Conditions (|4.6|) may be rewritten in the following form 

[Pi'\u)/2] + K(z.W)/2] = [(Pf)(z.) +m„(z.W))/2], 

where for any x G M, the symbol [x] stands for the nearest integer which is smaller or equal 
to X. Finally, let c(i/) denotes the charge of configuration z/, see (4J) for definition. 
• Show that if z/ G C(2)(A; /x), then 

c(z/) = e(A)(mod 2), 

where e(A) = X[ + X'r^ + X'^ -\ . 

Next, for any configuration u G C(2)(A; fi) define its spin by 

1 f (jj(k-i)y _ c (fc)y >| 
spin(z.) = 2 E ^ 2 ' ^^-^^ 

where for any s G M, the symbol {x}, < {x} < 1, denotes the fractional part of x. In 
other words, the spin(z/) of a configuration u is equal to the one fourth of the number of odd 
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numbers appearing among the all differences (i^*-'^"^'')^ — (^^'^^)^, k,n > 1. Recall that by 
definition u^^^ = /i. 

Finally, for any partition r such that |r| = |A| + \^\ define the (g, t)-domino polynomial 



!/GC(2)(A;Ter) k,n>l 



(4i 



where 

(a) A is a unique partition such that 2-core(A) = and 2-quotient(A) = (A,/i); 
(/?) for any configuration u G C(2)(A; r©r), c(z/) := (c(z/) — e(A))/2 denotes its normalized 
charge] 

(7) for any non-negative integer m we put m := [m/2]; 

' stands for the g-binomial coefficient. 



(5) as usually, 



n 



• Show that polynomials c\{q,t) have the following property: 

cX(l,l) = |Tab(2)(A,r)|, 

i.e. c\{l, 1) is equal to the number of semistandard domino tableaux of shape A and weight 
r. 

The formula ( [4.8| ) with q = 1 gives very effective method for computing the spin generating 
function on the set of domino tableaux. 

ii) Denote by S the Schiitzenberger transformation acting on the set of semistandard 
Young tableaux of the same shape: 

§ : STY{X,r]) ^ STr(A, V), 

where for any composition rj = {rji, . . . ,ris) we denote by ^ the "reverse" composition 
{ris,ris-i, . . . ,ri2,rii). See e.g. [|l3l, Appendix, where the transformation S is called evacu- 
ation, or 1^ pS] . 

Let A and /i be partitions such that |A| = 2|/i|, and 2-core(A) = 0. 

• Show that there exists a natural bijection 

^ : 5TF(A,/i V^)^ ~ Tab(2)(A,/i), (4.9) 

where for any composition /i = (/ii, . . . , /ip) the symbol /i V /i denotes the composition 
(/ii, /i2, • • • , /ip-i, /ip, /ip, fJ^p-i, • • • , fJ'2, yUi)- In other words, the set of domino tableaux of shape 
A and weight n is in one-to-one correspondence with the set of semistandard self-evacuating 
Young tableaux of shape A and weight yuVyU. Recall, see e.g., J. Stembridge (Duke Math. J. 
82 (1996), 585-606) that a tableau T G STY{X,fj,) is called self-evacuating if T is invariant 
with respect to the action of Schiitzenberger's transformation S. 

As far as I am aware, the statement that the set of self-evacuating Young tableaux of 
a given shape A and weight /z V /i is equinumerous to that of domino tableaux of the same 
shape A and weight fi was conjectured by R. Stanley and has been proved for the first time 
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by J. Stembridge [ibid\. An "elementary proof has been found later by A.D. Berenstein and 
A.N. Kirillov (Proc. of 10th Intern. Conf. FPSAC, Fields Institute, Toronto, 1998, p.55-66, 
and |q-alg/ 97090 1U| ). Explicit construction of a bijection between the sets of self-evacuating 



and domino tableaux was given by S. Fomin (Zap. Nauch. Sem. LOMI 55 (1986), 156-175) 
in the case /i = (1"), and was generalized by A.N. Kirillov, A. Lascoux, B. Leclerc and 
J.-Y. Thibon (C.R. Acad. Sci. Paris 318 (1994), 395-400) for general fi. 

• Show that if a domino tableaux T G Tab''^'*(A, /i) corresponds to the tableau T G 
STY{A, fi y /i)^ under the bijection ( ^.9| ) constructed by A.N. Kirillov et al. [ihicl\, and 
the semistandard tableau T corresponds to the pair [v] J) under the rigged configurations 
bijection, then 

spin(T) = spin(z/), (4-10) 
where the spin(z/) of a configuration v is defined by ( f4.7|) . 

Example 4.7 Take A = (321), ^ = (3) and z/ = (4321). Then A = (77411), A = (7321), 
R = (43321), and Ka^^(J)^{1) = 2642, K-^j^iq) = 9^(1367531). It is not very difficult to check 
that 

i^A,.e.(-l) = |Tab(2)(A,z/)| = K~,^{1) = 26, 
|C(A;z/©z/)| =47, |C(2)(A;z/©z/)| = 19, 

and (g, t)-domino polynomial is equal to 

qH + [q^ + 2q^ + 2q^ + q\\ + q^f + [3g^ + g^(l + g) + 3?^ + ^^(l + q) 

+ q\\ + q)\t^ + {q\\ + g) + 2g«(l + g)]t^ 
= qH + qH^\V + g(l + g)(2 + q)\ + q^t^{\ + g)[4 + g + q\ 

+ gV(l + g)[l + 2g]. 

iii) Let A and /i be partitions such that 2-core(A) = 0, and |A| = 2|/i|. 

• Show that for any admissible configuration z/ G C(A; yU © /i) 

2spin(i^) G Z>o and 2spin(i/) = c(i^)(mod 2). 

Assume additionally that A has a form 2v © 2z/ for some partition z/, or equivalently, that 
2-quotient(A) = [y, v). 

• Show that if z/ G C(2)(A; fiQ) fJ^), then 



spin(z/) G Z 



>o- 



iv) (Schiitzenberger transformation and rigged configurations) 
Let A be a partition, i? be a sequence of rectangular shape partitions, and T G LR{X, R) be a 
Littlewood-Richardson tableau. Denote by §(T) G LR{X, R) the image of tableau T under 
the Schiitzenberger transformation, see e.g. 
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• Show that if the pair (z/, {Jn^l}) corresponds to the tableau T under the rigged config- 
urations bijection, then the pair 



u,{P^'\u;R)-J 



(k) 



-J) 



(4.11) 



r!,,m„(i/(*))- 

corresponds to the tableau §(T). 

This result was discovered and proved by the author in some particular cases (including 
the case of semistandard tableaux). A proof in general rectangular case has been obtained 
by A.N. Kirillov, A. Schilling and M. Shimozono ||41|| . 

v) Let A and /i, /(/i) = p, be partitions, and T G STY{X,fj,) be a semistandard Young 
tableau of shape A and weight /i. With tableau T one can associate a word w := w{T) which 
is given by reading the numbers in T from right to left in successive rows starting with the 
top row. With the word w := w(T) one can associate a sequence of subwords Wi,W2, ■ ■ ■ ,Wp 
such that weight {wi) = (ll"''!) for i = 1, . . . ,p, see e.g. [|^, Chapter III, Section 6, p. 242. 

Next, let u be an admissible configuration corresponding to the tableau T under the rigged 
configurations bijection, see e.g. [0. 

• Show that 

(z/(i))l, = 9(«;,), l<k<p, 

where for any standard word w the symbol d{w) denotes the number of integers j such that 
j and j + 1 both appear in the word w, but j + 1 lies to the right of j. For example, if 
w = 5761324, then d{w) = 3. If w := w{T), then the numbers d{wk) are related to a 
structure of descent set Des(T) of tableau T, see e.g. . 

Recall p9|, ^ ^ that the rigged configurations bijection establishes a one-to-one 
correspondence between the set of Littlewood-Richardson tableaux LR{X, R) and that of 
rigged configurations RC{\, R). This bijection was discovered and constructed by the author 
in the middle of 80's, and since that time many interesting combinatorial properties (see 
e.g. 0, 0, ^ and the present paper) of rigged configurations bijection were found by the 
author, G.-N. Han, S. Fishel, M. Kleber, A. Schilling and M. Schimozono. 

4. Let p > 2 be an integer, A be a partition such that p-core(A) = 0, and i? be a dominant 
sequence of rectangular shape partitions such that |A| = p\R\. Denote by R^p'^ a dominant 
rearrangement of the sequence of rectangular shape partitions {R, R, . . . , R}. 



Denote by C(p)(A; R^^^) the subset of the set of admissible configurations C(A; R^^'^) con- 
sisting of all configurations u E C{X; R^^^) such that 



P 



(k)^ 



Plt\i^; R) 



P 



+ 



rrirAiy 



P 



for all integers k,n > 1. Recall that for any a; G M the symbol [x] stands for the nearest 
integer which is smaller or equal to x. 

If z/ G C(A; R^P^), denote by Ky{q) the following product 



KM) = Q^'^"^ n 



fc,n>l 



(fc)^ 



(4.12) 
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and if z/ G C(p)(A; R^'p^), denote by K'f\q) the product 



n 

k,n>l 



(4.13) 



where for any m G Z we denote by fh := [m/p\. 
It follows from Theorem |4.3| that 



(4.14) 



i/6C(A;i?{p)) 

• Show that if z/ G C(p)(A; i^^^')), then 

It looks a challenging task to describe explicitly the sign in the latter formula. 

• Show that if p = 2 or 3, then the integer numbers K^{(p) have the same sign for all 
configurations v G C(p)(A; i?^^^). Note that this is not true if p > 4. 

Conjecture 4.8 Let A and fi be partitions such that p-core{X) = and |A| = p\fi\. For any 
configuration v G C(p)(A; yU*^^^) one can define the integer number spin(z/) which is called by 
the spin of configuration u, such that 

J2 fPi°Hir(p)(l) =ep(A) 

i^eC(p)(A;M(p)) TeTa6(p)(A,/x) 

where ep(A) = ±1, and jj.^^^ = ji ® ■ ■ ■ ® jJi (p times). 

5. Let \, = (/ii > ■ ■ ■ > /ip > 0) and z/ be partitions such that |z/| = |A| + In the sequel 
we will identify a partition A with its diagram, see e.g. Chapter I, p. 2. 

Let Xi be the rightmost square in the top row of A, and let X2 be the leftmost square in 
the bottom row of fi. Let fi"" (respectively, fi^) denote the diagram obtained from by a shift 
sending X2 to the square immediately above xi (respectively, immediately right of xi) and 
let \* jjy (respectively, A * jj,^) denote the diagram XUp'" (respectively, A U /i^). Finally, let 
\* jj, denote the partition ((Af) + /i) © A and D (respectively, Dh and u^) denote a dominant 
rearrangement of the sequence of rectangular shape partitions ((A^), u) (respectively, (((Ai — 
lY),v) and ((An, z/). 

Show that 

K^.,rM = K,,,\uM + g"('■^•'^)i^A*M^^>.(?), (4-15) 

where a(A,/i, z/) is a non-negative integer which may be computed explicitly. 

The latter relation ( |4.15| ) between parabolic Kostka polynomials may be considered as a 



g-analog of the formula (1) from ^2|, Chapter I, Section 5, Exercise 21(a), in the case when 
both 9 and ip (see [ibid\) are partitions. 
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Note finally, see Section |, Exercise 3 ii), that 

ir,,^,,(l) = |Tab(2)(A,z/)|, 

where A is a unique partition such that 2-core(A) = and 2-quotient(A) = (A,/i). It will 
be interesting to find an explanation of the relation ( [4.15|) based on consideration domino 
tableaux only. 

6. (Examples of fewnomial parabolic Kostka polynomials) 

a. Let n > 2 be an integer. Consider almost staircase partition 

A = {2n, 2n — 1, ... ,n,n — l,n — 2, ... ,2,1), 

and sequence of rectangular shape partitions 

R={{2n-l),{n-),{{n-ir-'),{l)). 

i) Show that 

Kxn{q) = {n~l)q\ ^ > (1 + g)'- 

ii) Let > 1 be an integer. Consider partition 

\^^~^ = \®{2n-\)®---®{2n-\), 
^ V ' 

k 

and sequence of rectangular shape partitions 

R^^^ = {{2n -l),...,{2n- 1), K), ((n - 1)""^), (1)). 

V ' 

k+1 

Show that 



+1 



n — 1) + 3{n — l)q + 3n^ ^ 



1-q 

+ (3n - 4)g'^+i + (n - l)g'^+'] . 

In particular, limfc_oo A aC^) R('')[q) = ; • 

1-q 

b. Let n > 1 be an integer. Consider almost staircase partition 
A = (2n + 1, 2n, . . . ,n + l,n,n — 1, . . . ,2,1), 
and sequence of rectangular shape partitions 

R={{2n),{{n + m,{n-~'),{l)). 
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Show that 

A'Asto) = 9^ ^ / (1 + <!)(», + (ii - 

c. Let n > 1 be an integer, and A be the almost staircase partition from b. Consider a 
sequence of rectangular shape partitions R = ((2n), (n"), (n"), (1)). 
Show that 

^ n 



K^Riq)^q^ ^ ) {n + {2n-l)q + nq^). 
d. Let n > 2 be an integer. Consider almost staircase partition 

A = (2n, 2rr^l, 2n - 2, . . . , n, n^l, n - 2, . . . , 2, 1) 

and sequence of rectangular shape partitions 

i?=((2n-l),((n-iri),((n-ir-i),(l)). 

i) Show that 

n 

■ +1 



KxR{q) = q^'^^ (n - l,2n - 3,n - 1). 
ii) Let /c > 1 be an integer. Consider partition 

AW = a e (2n - 1) e (2n - 1) • • • e (2n - 1), 

^ V ' 

k 

and sequence of rectangular shape partitions 

R('^ = {{2n - 1), . . . , (2n - 1), ((n - 1)--^), {{n - 1)""^), (1)). 

^ V ' 

k+1 

Show that 

I n 

KxWR(k){q) = q^ 



2 



+1 



2 _ k+1 

n - 1) + (3n - A)q + 3n- ^ 



1-q 

+ {3n - 4)g'^+^ + {n - l)q''+^] . 

T r 1 r A- ( ^ • (n-l) + (2n-3)g + 4g^ 

In particular, limfe^oo -^^ac^) Rw{q> = ; ■ 

1-q 

e. Let n > 3 be an integer. Consider staircase partition 

A= (2n + l,2n, ...,2,1) 
and a sequence of rectangular shape partitions 

R = ((2n), {2n - 1, 2n - 1), {{n + 1)"-^), ((n - 1)"-^), (2)). 
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Show that 



KxR{q) = 2(n - 2)q 



n-2 



f. i) Let pn = (2n — 1, 2n — 3, . . . , 3, 1) be a partition with parts which are consecutive 
odd numbers, starting from 1 till 2n — 1. Consider partition A = /9„ © (2n) © (2n), and a 
sequence of rectangular shape partitions 

R = {{2n - 1), {n,..^.,n), {n,..^.,n), (1)). 



Show that 



( 


'n + 2 


,n, 


'n + 2' 




2 




2 



ii) Consider partition A = p„ © {2n + 1) © (2n), and a sequence of rectangular shape 
partitions 

R = ((2n), (rv^), (rv^), (1)). 
[^] [^] 

Show that 



n + 2 



,n + 1, 



n + 2 



iii) Let Pn denotes partition p„ + (0, . . . , 0, 1). Consider partition A = p„ © (2n) © (2n), 

n-l 

and a sequence of rectangular shape partitions 

R = ((2n - 1), (rv^, in^_^, (2)). 

Show that if n > 3, then 



n + 2' 





3n 




3n 






2 




2 





n + 2' 



iv) Let A be the same partition as in iii). Consider a sequence of rectangular shape 
partitions 

i? = ((2n-l),(n,...,n),(n,...,n_),(l,l)). 



Show that if n > 2, then 

, , \ri+2'\[n 



3n-2 



3n-2 



n 
2J 
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5 Generalized exponents and mixed tensor represen- 
tations 

Let = sl{N, C) denote the Lie algebra of all x complex matrices of trace 0, and 
G = GL{N, C) denote the Lie group of all invertible N x N complex matrices. Let 

ad : G Aut(g) 

denote the adjoint representation of G, defined by 

{adX){A) =XAX^\ 

where X G G, and A G g. 

The adjoint action of GL{N, C) extends to the action on the symmetric algebra 

where ^'^(g) denotes the k-th symmetric power. It is well known |^ that the ring 

/ = S'ief = {fe S'iQ)\x .f = f,yxeG} 

of invariants of this action is a polynomial ring in N — 1 variables /2, . . . , Jn-i, where /j G 
S'{q)'^. By a theorem of Kostant p[, 



S'{g) = I®H 

is a free module over G-invariants / generated by harmonics H. Moreover, 

H = ®p>oHP 

is a graded (so = H n 6*^(0)), locally finite g-representation. The graded character ch^ of 
the symmetric algebra of adjoint representation is given by the following formal power series 

ch,(5-(g)) = 5^g^ch(5'=(0))= n {l-qx./x,)-\ 

k>0 l<i,j<n 

For any finite dimensional g-representation V let us define 

G^{V) := Gr,{V; q) = ^^(y, if^g^ (5.1) 

where 

(Fi,\/2) = dim0Hom(l^i,\/2) 
is the standard pairing on the representation ring of the Lie algebra g. By a theorem of 



Kostant 42 



G;v(V^)|,=i = dimV^(0), 
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where V^(0) denotes the zero weight subspace of representation V. Hence, G'iv(l/) is a poly- 



nomial in q with non-negative integer coefficients. Follow Kostant ^2|, the integers ei, . . . , 
with 

s 

i=l 

are called generalized exponents of the representation V. Kostant's problem [ibid] is to de- 
termine/compute these numbers for a given representation V. 

Let V\ := vjf^^ denotes the irreducible highest weight A representation of the Lie algebra 



£1 := sl{N, C). Theorem |5]1| below together with the fermionic formula ( |4.2| ) for the Kostka- 
Foulkes polynomials, gives an effective method for computing the generalized exponents of 
irreducible representation of the Lie algebra g = sl{N). 

Theorem 5.1 (pO|) Let X be a partition, then 

r K .,,,^N^{q), if |A| ^ O(modiV), 
Gn{Vx) = \ "{(^) j 

I 0, otherwise. 



For an "elementary" proof of Theorem |5.1| , which is based only on the theory of symmetric 
functions, see |]TU| . 

Using Theorem |5.1| , one can compute, in principal, the generalized exponents for any 
finite dimensional g/(A^)-module V. What seems to be very interesting is that for certain 
representations, see below, there exist alternative expressions for the generalized exponents 
polynomials which have independent interest and more convenient for computations. Before 
turning to our main results of this Section, it is useful to recall a few definitions and results 
from iiH. 

Let a, (3 be partitions, and Va^\ V^^^ be the highest weight a and (3 (respectively) 
irreducible representations of the Lie algebra gl{N). For any finite dimensional 0/(A^)-module 
V let V* denote its dual. If l{a) + l{(3) < N, denote by V^^^^ the Cartan piece in the tensor 

product V^^'' ® Vg^^''*, i.e. the irreducible submodule generated by the tensor product of 
highest weight vectors of each component. Follow P, we call a representation obtained 
in this way by mixed tensor representation. Clearly, V"^^^^ is the dual of Vg^^\ 

Since it is irreducible, V^^'' is equal to v!^^'' for a unique partition A of less than rows. 



Let us write [a,/3]Ar for this A. It is well-known [Q, and goes back to D.E. Littlewood 



46 , that 



[a,/3]N = («! + /?!,..., as + . , /3i -/?,.,..., - A, 0), 

N~s-r 

where s = l{a), r = l{j3), and we assume that s + r < N . For example, 

y{N) _ y{N) _ ^ y{N) _ y{N) _ 
^0,0 — '^0 — ^, '^(1),(1) ~ '^(21^-2) ~ 

is the adjoint representation. 
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Theorem 5.2 ([0, |20[) i) Fix N > 1. Then the representations vj^^\ where partitions a 
and (3 satisfy l{a) + /(/?) < A^, and \a\ = \(3\, form a complete, repetition-free list of the 
irreducible finite-dimensional representations of the group PGLn; 

^^^) Gjv(V; ® V^*) := G^ivl''^ ® (^j^^)*) 

N 



, where fi'^, 1 < i < N , denote the column 



lengths of partition fi, and 



N 



-I q 



denotes the q-multinomial coefficient if rrii > 0, 1 < i < N , N = mi + ■ ■ ■ + tun, and 
otherwise. 



Our first result in this Section is Theorem below, which connects the generalized 
exponents polynomial G'Ar(V^ ® Vg*) with a certain parabolic Kostka polynomial, and gives, 
via Corollary |5^ , the first real means for computing the GNiVa ® VJ). 



Theorem 5.3 Let a,f3 be partitions, \a\ = /(a) < r. Then 
where R^ = {{Pi),..., iPi), 031)}. 



(5.2) 



N 



Corollary 5.4 (Fermionic formula for the generalized exponents polynomial GN{Va ® V^*)) 
Let a, 13 be partitions, \a\ = \(3\, l{a) < r. Then 



u k,j>l 



summed over all admissible configurations v of type ([a,/5]Ar; 

See Definitions |4.1| and |4.2| for explanation of symbols in the RHS ( p.3| ) 
Remark 5.5 Let a,/3 be partitions such that lia) + < A^, l[ci) < r. Then 

GN{Va ® v;) + 

if and only if \a\ = \P\modN and Pi = Pi + ^- — ^ , J^^ > 0; 



if so, then 
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(5.3) 



(5.4) 



where Rn = {(Pi), . . . , (Pi), (PI)}- 



N 



Also we have 



N 



where a = a, and /? = /?( 
if |a| < \p\. 



N 



N 



if lal > 1/31, and a = ai 



N 



-I g 

N 



(5.5) 
and P = P, 



Corollary 5.6 Leta,P be partitions, \a\ = \P\, then 



Haiq) ' 



(5.6) 



where Ki3a{q,q) denotes the specialization q = t of the double Kostka polynomial Kj3a{q,t) 
introduced by Macdonald /|5^, Chapter VI, §5; 

i>l 

Proof. It follows from Theorem ^.2| , Hi) that the 

LHS(0)= lim GN{y^®v:). 

N^oo 

If we compare the RHS(p73D with that of (|6.14|) , we immediately see that 



lim Gjv(V; ® V:) = q lim Sa * sp{q, . . . , g ) = s„ * 5^3(1, g, g ,...), 

where s^* 5/3(1, g, . . .) denotes the principal specialization Xi = g*~^, 1, 2, 3, . . ., of the internal 
product of Schur functions Sa and s^, see Section ^ for definition. It follows from |5^ , 
Chapter VI, §8, Example 3, that 



Sa * Sf3{l,q,q^, . . .) 



Kg/sjq, q) ^ Kf3a{q,q) 
Hp{q) HM) 



(5.7) 



Remark 5.7 The identity (p.6|) is essentially equivalent to the definition of Kostka-Foulkes 
polynomials Kx^{q), see Section (|2.1|). Indeed, by definition, 

s^{x) = 5^ K,,{q)P,{x; q) =J2 ^^f^^^-^^^ 
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Therefore, in the A-ring notation, we have 



Sf3 



X 



X 



By definition. 



X 



is the modified Hall-Littlewood polynomial, and 



On the other hand, by definition (see |Q, Chapter VI, (8.11)) 



or 



X 



q,t 



Now, if we put g = t in 



1-t 
I), we obtain 
X 



1. 



^Kx^{q,q)sxi 



Hence, 



These equalities imply 



X 



EE 



K^^{q)K^^{q) 



(5. 



(x). 



We conclude this Section with a generalization of Theorem ^ 
By a theorem of Kostant 



the symmetric algebra S'{q) of the adjoint representation 
of the Lie algebra qI{N) is isomorphic as the graded g/(A^)-modules to the direct sum of 
modules V^^V* when ^ ranges over the set Vn of all partitions whose length do not exceed 
N: 

Let Z > 2 be an integer, we are going to introduce and study I -restricted generalized exponents. 
Consider the algebra of /-restricted representations of the g-analog of universal enveloping 

algebra Uq{sl{N)), when q = exp I — : ) is the primitive (/ + A^)-th root of unity. This 



(0 

N 



l + N 

algebra, known as Verlinde algebra V{1, N), has generators Vx, where A ranges over the set V 
of /-restricted partitions, i.e. partitions A such that /(A) < A^, /(A') < /. The multiplication 
in the algebra V(/, N) is given by the so-called l-restricted tensor product, which we will 
denote by ®. We refer the reader to |27], Chapter 13, Exercise 13.34, for definition and basic 
properties of the Verlinde algebra. 
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Definition 5.8 Let I > 2 be an integer, define 

S!{9) = 0^f(fl), where 



\n\=k 



k>0 



and jji ranges over the set of I -restricted partitions, and = k. 

Definition 5.9 (/-restricted generalized exponents) Let V belongs to the Verlinde algebra 
V(/, N) . The l-restricted generalized exponents polynomial C'j^ (V) is defined by the following 
formula 

G^SiV) ■.= G^S{V;q) = Y.[V:St{2)] q\ 

k>0 

where for any two elements V and W of the Verlinde algebra V{1, N) the symbol [V : W] has 

the following meaning: 

let V = J2\ Q-A^A and W = b^jV^j^ be the decompositions of the elements V and W in 
terms of the generators Vx of the Verlinde algebra V{l,N). By definition, 

[V:W] = J2(ixh. 



Definition 5.10 (Verlinde polynomials) Let I > 2 and L > 1 be integers, and V e V{l,N). 
Denote by (S*{g)®^Y''^ the degree k component of the L-th l-restricted tensor power of the 
element S I {q) e V(/,iV). Polynomial 



k>0 

is called by Verlinde polynomial. 

>(0 



Let us denote by Vj^ the set of all partitions A such that 1{X) < N and Ai — Ajv < I- 

Problem 5.11 Let X,a,P be partitions from the set . Compute polynomials G^I^^\Vx) 
and G';i'''^(KW)- 



Theorem 5.12 Let A G P^J^ then 

m f |A|^0(mod7V), 

0, otherwise. 
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Here for a partition A G Vn^ and any partition /i the symbol K^^^{q) denotes the l- 
restricted Kostka-Foulkes polynomial. We refer the reader to p6|, Section 4.1, see also ref- 



erences therein, for a definition of the so-called l-restricted one dimensional sums xji\X) 
which we identify with /-restricted Kostka-Foulkes polynomials 

In my opinion, this is one of the most "natural" definitions of the /-restricted Kostka-Foulkes 
polynomials. Other definitions appeal either to the Representation Theory or Quantum 
Groups at roots of unity [folklore], or that of the Hecke-Iwahori algebras (Goodman F. and 
Wenzl H., Adv. Math. 82 (1990), 244-265). Restricted Kostka-Foulkes polynomials have 
many interesting combinatorial properties (restricted Young tableaux, restricted Littlewood- 
Richardson rule, . . .), and appear to be connected with the characters of Virasoro and affine 



Lie algebras, see e.g. [B^, p. 101-105; p6|. Section 5, and references therein. 



Problem 5.13 Let a and j3 he partitions of the same size from the set V^K Define /- 
restricted double-Kostka polynomial K^'j^{q, t) with the following properties 

i) K^J^^^{q,t) is a polynomial with non-negative integer coefficients; 

a) K^^^{0,t) is equal to the l-restricted Kostka-Foulkes polynomial K^^p{t); 

Hi) if I is big enough, then K^^^{q,t) coincides with the double Kostka polynomial Kap{q,t) 
introduced by Macdonald /|5^/, Chapter VI. 

See recent preprint by L. Lapointe, A. Lascoux and J. Morse, A filtration of the symmetric 
function space and refinement of the Macdonald positivity conjecture, [math. Q A/0008073 



where certain polynomials K^^{q,t) < Kx^{q,t) which might be satisfy the above conditions 
i) and ii), have been introduced and studied. 

Exercises 

1. Show that if /3 = {n), then the identity ( |5.6| ) takes the following form 

qnMK^^^(q) _ jr„,(in)(g) 

In the particular case a = (n), the identity (|5.9|) becomes 

This identity is due to Philip Hall (Comm. Math. Helv. 11 (1938), 126-129). 

2. Let q; be a partition of n. Show that 

MHn 
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In the particular case a = (n), we obtain a generalization of the Philip Hall identity ( |5.1CI| ): 



fi\—n 



^2nM nji,(i+ V"-''; 



3. Fusion rules and Catalan numbers. 

Let g""*"^ = 1, n = l(mod2) be a primitive root of 1 of odd order. For each integer m such 
that < 2m + 1 < n, denote by Vm the (2m + l)-dimensional irreducible representation of 
Ug{sl{2)). Show that 



Mnlt[Vo:V^] = Ck, if k < n - 2, 

2 

Mult[\/o : V|i1 <Ck, if k>n-l. 



Here denotes the k-th Catalan number. In other words, if n > + 2, then the Catalan 



number Ck is equal to the (n — 2)-restricted Kostka number where A = 

l)/2, k{n - l)/2) and /i = (((n - l)/2)2fc). 

Using the fermionic formula (|3.13|) for restricted Kostka polynomials, show that 



{k{n 



Ck 



En 



summed over all partitions u such that 

• \u\ = k{n - l)/2, Ui<n-2, 

• Pj{iy) := kmm{2j,n- 1) - 2Qj{iy) > 0. 

Thus, if n > k + 2, then {n — 2)-restricted Kostka polynomial K^^^ with A = 

{{k{n — l)/2)^) and /i = (((n — l)/2)^'^), see ( p.l3|) , may be considered as a g-analog of the 
Catalan number Ck- 

4. Generalized exponents for the Lie algebras of type A2 and ^3. 
a. Let A = (Ai > A2 > 0) and = {p) be partitions, |A| = 
Show that 



Gf (g) = /r,,(,3)(g) = g'= 



min(Ai - A2, A2) + 1 
1 



where c = max(Ai — A2, A2). 

b. Let A = (Ai > A2 > A3 > 0) and = (Z^) be partitions, |A| = |yu|. Show that 



1 



X 



2«a-l)-n(A)^(4)/ -1 



min(Ai - A2, A3) + 1 
1 



E 



,2a 



0<a< 



-''2 -■''3 



max(Ai — A2, A3) + 4 min(/ — A3 — a, A2 — Z — a, 0) + 1 

1 



A2— A3 



min(Ai - A2, A3) + 2 
2 
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where e 



1 + (-1)^2-^3 



c. Show that if A = (Ai > A2 > • • • > A^v > 0) is a partition such that A^v > I, and 
|A| = {N + l)l, then 



N 
a' 



where a — (Ai — /, A2 — /, • . . , A^r — /). 

d. Let A = (Ai > • • • > Ajv > 0) be partition such that / > A2, and |A| = {N + 1)1. Show 
that 

' N + 1 



-Af|/3|+n(/3) 



N 



where /3 = (A2, A3, .... \n). 

e. Let A = (Ai > A2 > A3 > 0) be partition such that Ai = A2 + A3, and |A| = 4/. Show 
that 



(l_gA.-A3+l)(i_ A3+l)2 l-gAa+l 

Kx,(i*){q) = — — —^ ^ eg 2+ 



where e 



6 Internal product of Schur functions 

The irreducible characters x'^ of the symmetric group Sn arc indexed in a natural way by 
partitions A of n. If w & Sn, then define p{w) to be the partition of n whose parts are the 
cycle lengths of w. For any partition A of m of length /, define the power-sum symmetric 
function 

Pa =PAi ■ ■ -Pxi, 

where Pn{x) = ^a;". For brevity write := Pp(w)- The Schur functions s\ and power-sums 
are related by a famous result of Frobenius 

«A = ^ 5] X^Hp«.- (6-1) 

For a pair of partitions a and (3, \a\ — = n, let us define the internal product * sp of 
Schur functions and Sp: 

Sa*sp^— ^ X"{w)x'^{w)p^. (6.2) 

^* r, 

w£bn 

It is well-known that 

where ct' denotes the conjugate partition to a. 
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Let 7 be partitions of a natural number n > 1, consider the following numbers 

= ^ E (6.3) 

The numbers g^p^^ coincide with the structural constants for multiplication of the characters 
of the symmetric group Sn'- 

XV = E^?-/57X"- (6.4) 

7 

Hence, (7q,/j^ are non-negative integers. It is clear that 

* S/3 = ^ ga/S^S^. (6.5) 

7 

Let us introduce polynomials L^p{q) via the decomposition of the internal product of Schur 
functions * Sp{x) in terms of Hall-Littlewood functions: 

s^* sp{x) = ^L^^p{q)P^{x]q). (6.6) 
It follows from ( PTT| ) and ( p^D that 

7 

Thus, the polynomials L'^/^iq) have non-negative integer coefficients, and 

The polynomials L^p{q) can be considered as a generalization of the Kostka-Foulkes polyno- 
mials. Indeed, if partition [3 consists of one part, (3 = {n), then 

KM = 

Example 6.1 Take partitions a = (4, 2) and (3 = (3, 2, 1), then 

Sa* = S51 + 2S42 + 2S4i2 + S32 + 85321 + 2S3i3 + + 2S22i2 + S2l4. 

Therefore, 

4^(9) = !, 4'?(g) = (21), 4^;^)(g) = (231), 4y(g) = (121), 
4r(?) = (3531), = (257531), 

4y(g) = (135531), Lf/^ = (2699631), 
(?) = (!, 4, 8, 12, 14, 13, 10, 6, 3,1) 

= (1 + g)2(l + g')(l + g + g')(l + q + g'), 
4'^ (?) = ?(1, 3, 6, 10, 14, 18, 20, 20, 18, 14, 10, 6, 3, 1) 
= q(l + qf(l + q^)(l + q^ + qy. 
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The value of polynomial L^i^{q) at g = 1 admits the following combinatorial interpretation. 
First of all, for any skew shapes A and B consider the set v{A^ B) of all 5-tableaux of shape 
A. Let 61,62;- •• be the row lengths of skew shape B, recall that a semistandard Young 
tableau T of (skew) shape A and weight (61,62, • • •) is called B-tableau, if the word w(T) 
associated to T (and given by reading the numbers in T from right to left in successive rows, 
starting with the top row) is a i?-lattice one. 

Recall that for a given skew shape B = X\fi, a. word w = W1W2 ■ ■ ■ Wp, Wi G Z>o, is called 
5-lattice, if for any j , 1 < j < p, such that Wj = k > 1, the following inequality holds 

#{i\i < j and Wi = Wj - 1} + min(Afe - /i^, /i^-i - yUfc) 

> — j Wi = Wj}. (6.8) 



In particular, if S is a diagram (i.e. /i = 0) then the definitions ( |6.8|) and ( 2.13| ) of B-lattice 
words and lattice words coincide. 
Summarizing, 

v{A,B) = {T e STY{A,{bi,b2,...))\w{T) is a 5-lattice word}. 

Let z/(A, B) be the number of 5-tableaux of shape A. It follows from and [|73[ that 

i/(A,5) = {sa,sb) = dimgz(„)(VSi, 14). 

Note that if A = A \ /i and 5 is a diagram, say B = rj, then z/(y4, B) is equal to the 
Littlewood-Richardson number c^^, i.e. the number of semistandard Young tableaux T of 
the (skew) shape A and weight rj such that the corresponding word w{T) is a lattice word. 

Example 6.2 Take A = (4332) \ (211), B = (5321) \ (21). Then 

^A,(322i) (g) = 4ni^.,322i(g) = ^^^^^ = 2 + 4g + 3^^ + 

vr TeS'ry(A,(3221)) 

On the other hand, I'lA, B) = 8. It is easy to check that two semistandard Young tableaux 
Ti,T2 of shape A and weight (3221), which correspond to the words w{Ti) = 11214233 and 
w{T2) = 41213231, do not belong to the set v{A, B). 



Proposition 6.3 (0) Let a, (3 be partitions, fi be composition and \a\ = = |/i|. Then 

L^pi^)= E \{y{A,Bi), (6.9) 

\Ai\ = \Bi\ = ^li 

Here the symbol stands for the disjoint union of sets Ai. 
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Definition 6.4 Let a,j3 be partitions, /i be composition, and \a\ = \(3\ = \fi\, l{fi) = r. A 
sequence of skew semistandard Young tableaux {Ti, . . . ,Tr) is called Littlewood-Richardson 
sequence of type if there exist two sequences of partitions 

{0 = ao C ai C a2 C ■ ■ ■ C ar = a} and {0 = /5o C /?i C • • • C /3r = /?}, 

such that 

i) \ai\ - = l^il - = Hi, 1 <i < r; 

a) Ti is a {Pi \ Pi_i) -tableau of (skew) shape ai \ ctj-i, \ <i <r. 

It is clear from (|0|) that L^piX) is equal to the number of Littlewood-Richardson se- 
quences of tableaux (Ti, . . . , T^) of type (a, /3; ii). We will denote this set by i/'^(a, (3) and its 
cardinality by z/^(a,/?). From the very definition, 

X 

It is not difficult to see that 

where /" denotes the number of standard Young tableaux of shape a. For a g-analog of the 
latter formula, see Exercise 1 to this Section. 

Problem 6.5 Find a statistics d on the set v^{a, jS) with the generating function L^p{q). 

Let N > 2, consider the principal specialization Xi = q"^ , 1 < i < N — 1, and = 0, if 
i > A^, of the internal product of Schur functions Sa and S/3: 

1 / k kN \ Pki'^) 

* g^ . . . , g^-i) = - J] x''{w)x'{w) J] • (6-10) 

By a result of R.-K. Brylinski |Q, Corollary 5.3, the polynomials 

Sa * Sfsiq, . . . 

admit the following interpretation. Let Pn,N denote the variety of by n complex matrices 
z such that = 0. Denote by 

Rn,N '■= C[Pn,N] 

the coordinate ring of polynomial functions on Pn^N with values in the field of complex 
numbers C. This is a graded ring: 

Rn,N = ®k>oRn^N^ 

Where R% is a finite dimensional £iZ(n)-module with respect to the adjoint action. Let a 
and (3 be partitions of common size. Then |^ 

fc>0 
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as long as n > max(M(a), Nl{P), l{a) + 

Our main result of this Section is Theorem ^]6| below, which connects the principal spe- 
cialization of the internal product of Schur functions with certain parabolic Kostka poly- 
nomials, and gives, via Corollary |6.7| an effective method for computing the polynomials 
Sa * S/3{q, . . . , Q^"^) which for the first time does not use the character table of the symmetric 
group Sn- 



Theorem 6.6 i) Leta,f3 be partitions, \a\ 
the sequence of rectangular shape partitions 



0\, l{a) < r, and l{a) + /(/?) < Nr. Consider 



N 



Then 



Sa* Sfsiq, - ■ . ^) = K[a,p]t,r,RN{<l)- (6-11) 

a) (Dual form) Let a, (3 he partitions such that \a\ = /(a) < r and l{(3) < k. For 
given non-negative integer N such that ai + /?i < Nr, consider partition 

Xn := (rN - pk, rN - p^-i, ...,rN-p^,a) 

and a sequence of rectangular shape partitions 



R 



■N 



N 



Then 



Kx^R^iq) = Sa* sp{q,...,q 



N-l\ 



(6.12) 



Corollary 6.7 (Fermionic formula for the principal specialization of the internal product of 
Schur functions, [0, ^) Let a, (3 be partitions, \a\ = l{a) = r. Then 



Sa * sp{q, ...,q 

f k,j>l 



iV-l^ 



(6.13) 



Pj''^(z/) + mj(z/W) + A^(A; - l)6j p,e{r - k) 



where the sum runs over all admissible configurations v of type ([a,/3]7v, (/^i^))- 
See Definitions |4.1| and |4.2| for explanation of symbols in the RHS ( [61131) . 



Corollary 6.8 (|^) Let a,/? be partitions, \a\ = |/?|. Then the principal specialization 

Sa * Sfs{q, . . . ,g^"^) 
is a symmetric and unimodal polynomial. 
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At the end of this Section we discuss a connection between the structural constants gap-y 
and the decomposition into irreducible parts of the exterior algebra 

A'(fl) = ©fc>oA'=(0) 

of the adjoint representation q of the Lie algebra gl^n). 

To start, let us recall the well-known formula for the graded character ch.q{A*{g)) of the 
exterior algebra of adjoint representation: 

ch,(A-(0)) = 5^g'=ch(A'=(0))= n + 

fc>0 1<«J<" 

For any finite dimensional gZ(r;,)-module V, let us consider the following polynomial 

E^{V) := Er,{V;q) = J^MultfV^ : A\g)]q'. 

k>0 



Problem 6.9 Let Vx and be irreducible finite dimensional representations of the Lie al- 
gebra gl{n). Compute the polynomials En{Vx) and EniVx ® V*). 

By a theorem of Berenstein and Zelevinsky f^, it is known that 

i) E4Vx)U=i = 2"Mult[l^A : Vs ® Vs]; 

ii) ("Kostant conjecture") 

• En{Vx) 7^ 0, if and only if 25 > A with respect to the dominance ordering on the set of 
partitions; 

• En{Vx)\q=i = 2" if and only if there exists a permutation w E Sn such that A = 6 + w{6). 
Recall that 6 := 6n = (ri — 1, n — 2, . . . , 2, 1, 0). 

Proposition 6.10 (|6^, §4) Let A be partition, 26 > X. Consider partition A = A + (l*^), 
then 

En{Vx) = {l + q)\ Yl 9nMj\^ (6-14) 

(l,=(a\b) J 

summed over all hook partitions fi = {a + 1,1^) , a + h = — 1. 
Proof. Consider the g-discriminant of order n by n: 

Ag{Xn) = J]^ (a^i - qxj). 

l<i,j<n 

It is a symmetric function in Xn = {xi, . . . ,Xn), and we can consider the decomposition of 
g-discriminant Aq{Xn) in terms of Schur functions sx{Xn)'- 

A,{Xn) = J2 er^{q)s^{Xn). 
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It is not difficult to see that 

where A = A + (1"). On the other hand, 



Ag(X„) = s„2((l - g)X„) = ^(s„2 * S3;)(l - q)sj{X„ 



Al-n2 



Al-n2 y^thn^ 



so that 



er- 



It remains to use the well-known fact, see e.g. |]52|, that 

[l-q){-q)\ if /i=(a + l,l^) 



0, 



otherwise. 



Thus, the problem of computation of polynomials En{Vo,) is equivalent to finding the 
structure constants ga/s-y of the multiplication of the characters of the symmetric group 5'„2 
in a particular case when a = (rP), (3 \- rt^ and 7 = (a|fe) is a hook partition, a + h = rt^ — 1. 

Proposition 6.11 Let a and P be partitions of the same size n? — n whose length do not 
exceed n. Then 



EniV^ ® V;) = J2 Ki^\-q)K'-^'\-q) U^ q "9) 



(6.15) 



Al-n2 



i>0 



where K{^J^\q) denotes the so-called inverse Kostka-Foulkes polynomial, i.e. the (A, jj,)-entry 



of the inverse Kostka-Foulkes matrix {Kx^^{q))~^ ; in the product on the RHSj ^Jdj) we made 
the convention that Aq = n; the sum ( ]6'. 1 3^ ) is taken over partitions A of size such that 
A < (2n + 1, 2n — 1, . . . , 3, 1) with respect to the dominance ordering on the set of partitions. 
Note that K\^^\q) = 0, unless A > /i. 



Formula ( |6.15|) is a special case of a result obtained by M. Reeder [^. Follow [^, we give 
below a proof of this formula which is based only on the theory of symmetric functions. 



Proof of Proposition \6.1]\ . Consider the ring A„(t) of symmetric polynomials in n in- 
dependent variables Xi, . . . ,x„ with coefficients in the field Q{q) of rational functions in q. 
There exist two natural scalar products ( , ) and ( , ) on the ring A„(t) with values in the 
field Q{t). The first scalar product ( , ) is characterized uniquely by the condition that the 
set of all Schur functions 



{sx{Xn), A runs through all partitions of length < n} 
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forms an orthonormal basis of A„(t) with respect to the scalar product ( , ). Similarly, the 
second scalar product ( , ) is defined uniquely by the condition that the set of all Hall- 
Littlewood polynomials 

{Px{Xn; q), A runs through all partitions of length < n} 

forms an orthogonal basis in A„(t) with respect to the scalar product 



1 

WxiqY 



where 

(1 - qTwxiq) = bx{q){q; q)n-x[- 

It is well-known, see e.g. Chapter VI, §9, that these two scalar products are con- 

nected by the following relations: 

if,g) = (/An(g),^), {Lg) = {f/An{q),g), 

where 



Now we are ready to prove Proposition |6.11| . First of all, if 



then 
Thus, 



= ^isa,,P^){sp,P^)w^{q). 

It remains to observe that since 

Saix) = ^Karj{q)Pr,{x;q), 



the scalar product (sq,,P^) is equal to the inverse Kostka-Foulkes polynomial K\ia\q). 
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Remark 6.12 Similar arguments may be used to prove the statement in) of Theorem ^ 
Namely, 



Kaf,{q)K(3f,{q) {q;q)r 
bM) {q;q) 



Remark 6.13 Combinatorial interpretation of the inverse Kostka-Foulkes polynomials 



K{^J^\q) was obtained by Egecioglu and Remmel See also an interesting paper by 



J.O. Carbonara in Discrete Math. 193 (1998), 117-145. 
Exercises 

1. Let a,P be partitions, |a| = = n. Show that 

La/3 il) = Kp'a{q,q)Kc,,(i^){q) = 

where 

Kaf3{q,q) ■■= K^p{q,t)\q=t, 

and Kai3{q,t) stands for the double Kostka polynomial introduced by I. Macdonald [5^ , 
Chapter VI, (8.11). 

2. (Two variable generalization of polynomials L^^(g)) Let a,/?,/! be partitions, \a\ = \P\ = 
\fi\ = n, define 

7 

Polynomials L^^/^iq, t) may be considered as a generalization of the double Kostka polynomials 
Ka^{q,t). Indeed, if /3 = (ra), then 

Laf^iq^'t) = Kai,iq,t), and L^^i^-^„^{q,t) = K^>^{q,t). 

Polynomials L^p{q,t) have properties similar to those of Ka^{q,t). 
Show that 

i) K,m=KM^ 

ii) L^^(0,0) = gai3fj., L'^pi^A) = /"/^; where denotes the number of standard (i.e. 
weight (l'"')) Young tableaux of shape a; 

iii) L'^piq^'t) = L^l'p'it^q)] 

iv) L^^(g,t) = 

v) L]^0{q,t) = Ka'f3it,t)Kf3^^in){t) = Kp>a{t,t)Ka,(ir^){t). 

vi) let a, (3 and fi be partitions of the same size, then 



J2KML%{q)/b,{q) = L^^^{q , q) / H ,{q) , 
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where H^{q) denotes the hook polynomial — q'^'^^^), and for any partition r] we put 

^(?) = Yl((l'^(l)v'-vi+^^ c.f. Corollary U. 

i>l 

3. Let A and fi be partitions and A > /i with respect to the dominance ordering on the set 
of partitions. Denote by d{a(3^) the degree of polynomial L'^^{q), and consider polynomial 



Show that 



i.e. the difference L^p{q) — L'^i^{q) is a polynomial with non-negative coefficients. More 
generally, let I := [/ii,/i2] be an interval in the Young graph (Y, <), then 

l^{r;I)Ll^iq)>0, 

where /x(r; J) denotes the Mobius function of the interval /. 

If partition a (or /3) consists of only one part, the latter inequality was discovered and 
proved by Lascoux and Schiitzenberger [|^; see also ||3^ for yet another proof. 



• Construct a natural embedding of the sets 

Hence, for any partition fi there exists a natural embedding (standardization map) 

: u^ia^p) ^ STY{a) x STY{(3). (6.16) 



Problem 6.14 Describe the image of the standardization map ( \6.1(^ ). 



Problem 6.15 Let a and (3 be partitions, define coefficients r^^], via the decomposition 

N\a\ 



Sa * sp{q, . . . , ^) = XI V 



k=0 

It follows from Corollary \6. d[ that if 1 < k < -N\a\, then 

AN) ._ (TV) _ (TV) Q 
yal3k ■~ ' af3,k ' af3,k-l — 

Give a combinatorial, algebra-geometrical and representation theoretical interpretations of 
the non-negative integer numbers g^^l- 
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4. Let > 1, M > 1 be integer numbers. For any pair of partitions a and (i of the same 
size n, consider the following polynomial (cf. ( |6.10| )): 



1 



(6.17) 



A:>1 



It is clear that 



li={a\b) 

summed over all hook partitions = (a + 1, 1^), a + 6 = n — 1. 

• Show that Sai3-N,M{q) is a polynomial with non-negative integer coefficients. 

Example 6.16 Take partitions a = (31) and (3 = (22). Using the character table for the 
symmetric group 5*4, one can easily find the following expression for the internal product of 
Schur functions in question: 



and therefore, 

S al3;n,m{.'i) = 'f 



n + m - 


- 2 " 




2n + 2m — 5 




' 3 " 




n + m — 1 


1 




9 


1 


1 


1 


4 



+ q' 



3 
1 



n + m — 2 
4 



+ q 



2n+2 



n — 1 
1 



m — 1 
1 



In particular, 



^«/3;2,2(g) = q\l + q + q')+q' = q\l + qf . 
Problem 6.17 Find a fermionic formula for polynomials Sai3-N,Miq) which generalizes that 



(EM 



5. Let a be partition of size n>2. Consider the new partition 

\a = a + ((n — 2)") = («! + n — 2, 02 + n — 2, . . . , q;„ + n — 2). 

Show that 

(jj)G« 



(6.18) 
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In particular, if « = (1""), then 



is the Poincare polynomial of the unitary group U{n); if a = (2, 1" i.e. the highest weight 
of the adjoint representation, then 



1 _ 2(n-l) 
2j-l\^__S__ 



Formula (|6.18| ) was stated as a conjecture by Gupta and Hanlon p2[ and has been proved 
by Stembridge |^ . 



6. Assume that partition A has the form A = (5„ + w(5„) for some permutation w G Sn- Show 
that 

k>l 

where ak{w) is equal to the length of the longest subsequence of w that can be written as 
union of k increasing subsequences. 

7. (Exphcit description of partitions A such that En{Vx)\g=i = 2") 

By a theorem of B. Kostant (see ||^, Proposition 13) and that of A. Berenstein and 
A. Zelevinsky p|. Theorem 14, the partitions A such that En{V\)\q=i = 2" are in a bijective 
correspondence with subsets / C [l,n — 1]: partition A (J) corresponding to / is equal to 
6n + wi{6n), where wi is the element of the maximal length in the Weyl group generated 
by the simple reflections Sj, i G /. The main purpose of the Exercises 6 and 7 is to give a 
direct construction of the partition A(/), and describe explicitly the RHS( |6.1^ ) in terms of 
the subset /. 

Let / be a subset of the interval [1, n — 1]. For each j G [1, \ / we define two numbers 
kf{j) and kj{j): 

• Let us put kf{n — 1) = kf{n) = 0, and if 1 < j < "n, — 2, then 

kf{j) = max{k\[j + l,...,j + k]cl}. 

Thus, we have kf{j) = 0, if j + 1 ^ /. 

• Let us put kj{l) = 0, and if 2 < j < ra, then 

KU) = max{A;|[j - /c, . . . , j - 1] C /}. 

Thus, we have kj{j) = 0, if j — 1 ^ /. 

Finally, let us define partition A(/) = (Ai(/), . . . , Xn{I)) by the rule 

A(/), = X;(2 + kjij) + kt{j))x{j ^ I). 

• Show that 
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if and only if there exists a subset / C — 1], such that A = A (J). Thus, the number of 
partitions A such that E{yx)\q=i = 2" is equal to 2"~^ 

8. Let / = {1 < ji < j2 < ■ ■ ■ < jp < — 1} be a subset of the interval [1, n — 1]. Define 
by induction the composition m = (mi, . . . ,ms) of the number p = #|/|. First of all, put 
mo = 1. If 2 > 1 and the numbers mo, . . . , mj_i have been already defined, then put m^ = 

max{A; G + 1 - mo m^.i] | jmo+-+mi.i+k-i = jmo+-+m,_i +k-l}. 

Let s := max{j|mj ^ 0}, it is clear that mi + ■ ■ ■ + m^ = p. 
Show that 

S "Ij 

j=l r=l 

where c(/)=(«)-E;.,(%+'). 

In particular, if / = {1, 2, . . . , j, . . . , n — 1}, then 

j—l n—j~l 

EniV.^i)) = q'^'-'Kl + qf + q'"-^') fl (1 + q'"-^')- 

r=l r=l 

9. Let A = (Ai, A2, . . . , A„) be a partition. Show that 

• (Reduction formulas) 

i) if A > 2£„+i, then En+iiy>) = g"(l + q)Eniy~^), 

where A = (Ai — 2, . . . , A„ — 2); 
11) if A > 25„, then En+i{V^) = g"(l + q)E„{Vx), 

where A = (2n, Ai, . . . , A^). 

• (Duality symmetry) 
E^iVx) = K(^;) = En{Vx+), 

where A"*" = (2n — 2 — A„, 2?7, — 2 — A„_i, . . . , 2n — 2 — Ai). 
In the case q = 1 these formulae may be found in 

• (Poincare duality) 
En{V;q)=q^(^"'^EniV;q-'). 

10. Show that 

J2 EniVx;-q)GniVx;q) = l, 

\<25n 

where GniV; q) is the generalized exponents polynomial, see ( |5.1|) . 

11. Let A = (Ai > A2 > ■ ■ ■ > Afc > 0) be a partition of n. Show that 



5,6. 



K 



(-1) 

A,(l") 



(g) = (_l)|Ahfc^d(A) 



2) 



A'l 
,A1 



(6.20) 
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where d{X) = n(A) + |A| + k{k + l)/2. 

Formula (|6.20|) was conjectured by J.O. Carbonara and proved by I.G. Macdonald, see 
Discr. Math. 193 (1998), 117-145, Proposition 3. 

12. Let a and f3 be partitions of the same size n. Show that 

where Kj^^\q,q) denotes the a)-entry of the inverse matrix {{Kx^{q,q))x,^\-n)~^ of size 
p{n) by p{n). Here p{n) stands for the number of partitions of size n. Recall, see |5^ , 
Chapter VI, Example 6, p. 364, that 

13. (Generalization of Corollary |6.8| ) Let a and (3 be partitions of the same size and 
(fci, /c2, • • • , K) be a unimodal and symmetric sequence of non-negative integer numbers. 

Show that the specialization 

* spjq, . , g, . ^. , g^^ , . . . , f, . ^. , g^J (6.21) 

fci k2 kr 

is a symmetric and unimodal polynomial. 

This result is due essentially to A. Kerber, see e.g., R. Stanley (Studies in App. Math. 
72 (1985), 263-281), or H], Theorem 14. 

Question. Does there exist a fermionic formula for polynomials (|6.21|) , which generalizes 
that ( |03|) ? 

14. Let A be a partition of size n. Consider partition A = (3n, 2n, A) and a sequence 
of rectangular shape partitions R := ((n, ra), (n, n), (n), (n)). Let s\{l,q,q,q'^) denotes the 
specialization xi = 1, X2 = = q, x^ = g^, Xk = 0, if k > 5, of the Schur function s\{x). 
Show that 



7 Liskova semigroup 

7.1 Realizable polynomials and product formula 

Definition 7.1 A polynomial P{q) G N[g] with non-zero constant term is called K -realizable 
if there exist two partitions A and fj,, |A| = \p\, a composition rj, \ri\ = l{fj,), and an integer L 
such that 

Piq)=q'^KxM. 
The set of all i^T-realizable polynomials will be denoted by £. 
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Definition 7.2 A polynomial P{q) G N[g] with non-zero constant term is called PK-reali- 
zable if there exist a partition X, a dominant sequence of rectangular shape partitions R, and 
an integer L such that 

Pig) = q'^K.niq). 

The set of all PK-realizable polynomials will be denoted by £"*". 

Definition 7.3 A polynomial P {q) G H-gN[g] is called KF -realizable, if there exist partitions 
A and fi such that 

P{q) = KxM- 

The set of all KF-realizable polynomials will be denoted by It is clear that C 
£+ C £. 

Problem 7.4 Describe the sets £, il^ and £^+. 
Conjecture 7.5 If n > 3 and a G Z>i, then 1 + aq" ^ £. 

Conjecture 7.6 Let K\ii{q) = q*{ao, ai, . . . ,ai) be parabolic Kostka polynomial correspond- 
ing to a partition A and a dominant sequence of rectangular shape partitions R. Then both 
sequences (ao, 02, 04, . . .) and (ai, 03, 05, . . .) are unimodal. 

What one can say about the structure of the sets £, £"*", and £++? First of all, it follows 
from Duality Theorem that if a polynomial P{q) belongs to the set £"•", then the polynomial 
gdeg(P)pj^g,-i-j g^Yso belongs to the set £"*". Another interesting property of the set £"*" follows 
from the following result. 

Theorem 7.7 Let a and (3 be partitions, and R, S = {(/ia")}, 1 < ct < be two dominant 
sequences of rectangular shape partitions. Let k = fia, and n be such that n > l{a) + l{[3), 
and n > rja, l<a<j5. Consider partition 

[a,P]n^k ■= ("1 + k,a2 + k,...,as + k,k^^^^,k- Pr,---,k- Pi), 

n—s—r 

and a dominant rearrangement Q of the sequence of rectangular shape partitions -RU{(/i^~''")}^^ 
Then 

Kla,i3U^^Q{q) = KaR{q)Ki3s{q). 

It follows from Theorem [7.7| that the set of PK-realizable polynomials £"*" is closed under 
multiplication, and forms a semigroup called by Liskova semigroup. 

Question. Denote by J?^ the set of all degree n parabolic Kostka polynomials K\R{q) 
corresponding to a partition A and a dominant sequence of rectangular shape partitions R. 
Is it true that the set J?^ is finite for all n > ? If so, what does the generating function 
E„>o|i^+|t" looks like? 
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Conjecture 7.8 Let P{q) be a polynomial with non-negative integer coefficients and non- 
zero constant term. There exists a non-negative integer N , depending on P{q), such that the 
product (1 + q)^ P{q) belongs to the Liskova semigroup 

The least non-negative integer such that (1 + q)'^P{q) G will be denoted by IL{P). 
For example, one can show that if n and m are non-negative integers then IL{n) < 2, see 
e.g., Section ||, Exercise 6, and IL{n + mq) < \n — m\+ 5n,m- 

Problem 7.9 Given an integer n > 3, compute the number IL{1 + g"). 



7.2 Generalized g— Gaussian coefficients 

Let A be a partition, and 



n 
A 



denotes the generalized g-Gaussian coefficient, |53|, Chapter I, §3, Example 1. Then the 



polynomial ^ is KF-realizable. This statement follows from [^, Lemma 1. Namely, let 
A be a partition, consider partitions 

A;v = (iV|A|, A) := (iV|A|, Ai, A2, . . .), and /i^ = = (|A|, . . . , |A|). 



N+1 



Then 



K 



N 
X' 



(7.1) 



See [ p2| , |35[] for proof and further details. It has been shown in ||3^, ^ that the identity ( |7.1| ) 



can be considered as a generalization of the KOH identity ( [4.5| ), see |5^, |71 



Identity ( |7.1| ) admits a generalization. To start, let us recall the well-known facts (see, 
e.g. g. Chapter I) that 



SA(l,...,g 



n{X) 



N 
X' 



s,*s^„){h...,q''~') = sx{l,...,q''-') (7.2) 



and hence 

sx * S(„)(l, . . . , q^-^) = Kx^f,^{q), (7.3) 

where Aat = (A^|A|, A), and fiN = (|A|^^^). We will give below a generalization of ( [7. 3D when 
partition {n) is replaced by an arbitrary rectangular shape partition. 

Theorem 7.10 Let X be a partition, and R = (Z™) be a rectangular shape partition, \X\ = 
Im. Consider the partition X^ = {Nl, . . . Nl, A) and the sequence Qn of rectangular shape 

m 

partitions Qn = {R, ■ ■ ■ ,R)- Then 

N+1 

sx*sn{q,...,q''-') = Kx,QAQ)- (7 A) 
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Remark 7.11 In Section Theorem |6.6| , we gave another generahzation of the identity 
( [7.3|) when partition (n) is replaced by arbitrary partition f], \f3\ = n. As a corollary, we 
obtain the following identity 



where 



K[a,R]Nr,RNiQ) = -^"iV,Qiv('?), 

[a,R]Nr = (ai + /,... + /, /^_^^^), 

Nr—r—m 

aisi = {Nl, . . . , Nl,ai, . . . ,ar), 



R 



N 



and r = /(a) 



7.3 Multinomial coefficients 

Lemma 7.12 Chapter I) Let A = (n, 1™) be a hook, and fi be a partition. Then 



It follows from Lemma |7.12| and Theorem |7.7| that the g-multinomial coefficient 



N 

mi, . . . ,mfc 



where rrij, 1 < i < k, are non-negative integers and N = mi + ■ ■ ■ + m^, belongs to the 
Liskova semigroup Indeed, 

N — mi — ■ ■ ■ — mk-i 
rrik 

Question. Is it true that the g-multinomial coefficients belong to the set 



N 




' N ' 




N — mi 




..,mk _ 


q 


mi 


1 


m2 


1 



Note, that according to Section]^, (|3.23|) , the g^-binomial coefficient 



n 
m 

N 

mi,...,mk 



also belongs 



belong 



to the Liskova semigroup £"^. Thus, the g^-multinomial coefficients 

to the Liskova semigroup as well. 
Questions, i) Is it true that for any partition A the generalized g^-binomial coefficient 
belongs to the Liskova semigroup ? 



n 
A 



ii) Assume that some symmetric and unimodal polynomial P{q) belongs to the Liskova 
semigroup £+. Is it true that the polynomial P(g^) also belongs to the semigroup ? 
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7.4 Kostka— Foulkes polynomials and transportation matrices 

Let X, fi be partitions, |A| = and n,N be natural numbers such that /(A) < n, < n, 
and N > \i + fii. Let us define partitions = {N"-) and 

= {N - Xn, N - Xn-l, ...,N-Xi,Hi,H2,...,fln)- 



Theorem 7.13 Let X, ^^n, N, and /3n be as above. Then 



II) 



If N>\Xl then K^^p^{q) = Y,Kvx{(l)K^M)- (7-5) 

Identity ( |7.5| ) admits the following combinatorial interpretation. First of all, note that 
the value of the LHS(|7.5|) at g = 1 is equal to the number of plane partitions vr of shape 
(A^") whose diagonal sums are fixed. More precisely, vr = (7rjj)i<j<j<„ is a n by n matrix of 
non-negative integers such that 

T^ij > TTj+lj, 1 < Z < n - 1, 1 < j < n; TXij> TTjj+i, 

k k 

l<i<n, l<j<n-l; ^ T^jM-j+i = ^-n-k+j] 

n—k+l n 

7r„_j+i,fc+j-i = ^ Aj, l<k<n. 

j=l j=k 

Indeed, let T be a semistandard Young tableau of shape (A^") and weight (A^ — A„, — 
An_i, . . . , N — Xi, fii, . . . , fin)- Denote by dij, l<i<n, l<j< 2n, the number of cells 
in the z-th row of T occupied by numbers that do not exceed j. Consider the diamond 
TT = {TTij), where 

TTij = N — dij, I < i < n, 1 < j < 2n — 1, and 0<j — i<2n — 1. 
It is clear that > 7f,;+i j, 7r.y > 7fjj+i and 

k k n n 

X^^ifc = X^Atn-fc+i' '^^j,n+k~l = '^Xj, 1 < k < n. 
j=l j=l j=k j=k 

If we put Tiij = Tiij-i+i, we will obtain the plane partition tt = {T^ij)i<i,j<n as it was defined 
above. 

Clearly, the diamond tt defines two semistandard Young tableaux P and Q of the same 
shape: P of weight A = (A„, A„_i, . . . , Ai) and Q of weight *Ji = (/i„, . . . , /ii). The 
statement ii) of Theorem |7.15| is equivalent to the following pure combinatorial one: the 
difference of charges 

c(T) - c(§(P)) - c(§(Q)) 
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is a constant depending only on n, A and /i. Here S denotes the Schiitzenberger transformation 

§ : STY{x,fi) ^ srr(A,^) 

on the set of semistandard Young tableaux of shape A. See e.g. or |T^, Appendix, p. 184, 
where the transformation § is called evacuation, or [0, ISF 



Theorem 7.14 Let A,/i be partitions, |A| = \fi\, /(A) < n, N > Ai. Let us define the 
rectangular shape partition aN = (n^), and dominant sequence of rectangular shape partitions 
R^ = {fi,{l'^-'-),...,{l'^-'^)}. Then 

It) If N>\Xl then K^^R^{q) = Y,KnMK^'M)- (7-6) 

■n 

More generally, let [3 be partition, < n, and R, S = {{fJ^a°')}a=i be two dominant 
sequences of rectangular shape partitions such that "^rja = n, and l^l = \R\ + Consider 
partitions = {N — — Pn-i, ■ ■ ■ ,N — and a dominant rearrangement Qj\[ of the 

sequence of rectangular shape partitions R U {(A^ — /la)^"}^^^. 

Theorem 7.15 

tt) If N>\S\, then K^,Q,{q) = Y,K,\p^R{q)K,^s{q)- (7.7) 

7 

Similarly, let j3 be partition, /(/?') < /c, and R, S = {(/i2'')}a=i be two dominant sequences 
of rectangular shape partitions such that '^fia = k, and \S\ = \R\ + Consider partition 
aN = {N — Pk, N — Pk-i, ■ ■ ■ ,N — PiY, and a dominant rearrangement Qat of the sequence 
of rectangular shape partitions RU { (/i^~^" )}„=!• 

Theorem 7.16 i) K^^q^ < Ka^^,Qj,+,{q); 

zz) If N>\S\, then K^,Q,{q) = Y,K,'\p'Aq)K,M)- (7-8) 



7.5 Gelfand— Tsetlin polytope and volume of weight subspaces 

Let A be a partition and /i be a composition of the same size and whose lengths do not exceed 

n(n + l) 

n. Let GT{X,fi) be the convex polytope in the space M 2 of all points x = {xij)i<i<j<n 
satisfying the following conditions 

• Xin = Xi, I < i < n; 

• > ^ij, ^ij > for all 1 < 2 < j < 72 — 1; 

• xu = /ii, and if 2 < j < n, then Y,i=i ^ij - Yji=i = /^i- 

The polytope GT{X,^) is called Gelfand-Tsetlin polytope. The following result goes back 
to the original paper by Gelfand and Tsetlin (Doklady Akad. Nauk SSSR (N.S.) 71 (1950), 
825-828), and was rediscovered many times. 
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Proposition 7.17 Dimension dimVx{iJ,) of the weight /i subspace Vx{fi) of the irreducible 
highest weight A representation Vx of the general linear algebra Ql{n) is equal to the number 
of integer points in the Gelfand-Tsetlin polytope GT{X,^): 



Conjecture 7.18 ([^) Let X and /i be partitions. All vertices of the Gelfand-Tsetlin poly- 



tope GT(X,fi) have integer coordinates, i.e. GT{X,fi) is a convex integral polytope. 
If Conjecture [7.18| is true, then 

^ - ,1 _ P>~fl(t) QN 

lx,l^ll^ - (I _ ^Y+i ' ^'■^> 



1>G 



where d = dim GT {X, fi), and Pxti{t) is a polynomial with non-negative integer coefficients 
such that Pxfii,^) is equal to the (normalized) volume of the Gelfand-Tsetlin polytope G{X, fi). 

Another consequence of Conjecture [7.18| , which can be proved using the specialization 
g = 1 of fermionic formula (|4.2| ), is that the Kostka number Kix^i^ is a polynomial £xii{l) in ^ 
with integer coefficients. We will call the latter by Ehrhart polynomial of the weight subspace 
Vx{ij), and denote it by Ex^iif). Hence, if I G Z>o, then 

£■\^l{t)\t=l = Kix^i^. 

It is well-known, see e.g.. Exercise 6 to Section 0, that in general the Ehrhart polynomial 
of a convex integral polytope may have negative integer coefficients. Nevertheless, based on 
examples, we make a conjecture that the Ehrhart polynomial Sxfj,{t) of the weight subspace 
Va(/x) has in fact non-negative integer coefficients. 

Example 7.19 Let n > 2 be a positive integer. Consider partitions A = (n") and fi = 
{{n — 1)'^,1'^). Then the Kostka number Kix^i^ is equal to the number of transportation 
matrices of size n by n with row and column sums both equal to (/"). Thus, Sxnit) is the 
Ehrhart polynomial of the Birkhoff polytope 

{n n ^ 

(x,,) G M"'| = 1, J2x,, = l\, (7.10) 

i=i j=i ) 

and Pxfii^) is equal to the normalized volume vol(i3„) of the polytope 

To our knowledge, the Ehrhart polynomial and volume of the Birkhoff polytope Bn are 
known only up to n < 8, |T0[. The (normalized) leading coefficient of Ehrhart's polynomial 



Sxfj,{t) of a weight subspace Vx{fi) is equal to the (normalized) volume of Gelfand-Tsetlin's 
polytope G{X,fi), and called by volume of the weight subspace Vx{fi)- It plays an important 
role in the theory of unitary representations of semisimple Lie groups (Harish-Chandra, 
Duistermaat J.J. and Heckman G.J.). 
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Exercises 

1. a. Let A be a partition, |A| = n. Show tliat 

E (AMi-)W)' = E''""'n 

i(A)<p v k,j>l 



(7.11) 



summed over all admissible configurations u G C{{n"'),{{n — 1)",1")) of the square shape 
(n") and weight {{n — 1)", 1"), such that < n — p, i.e. the number of parts of the 

partition u^^^ does not exceed n — p. 

For the reader's convenience, we recall the meaning of notions and symbols which were 
used in this Exercise (see Section ^, Definitions [4.1| and [4.2|) . 

First of all, summation in the RHS (|7.11|) is taken over all sequences of partitions u = 
{i/(i),z/(2),...} such that 

• = n{n — k), 1 < k < n — 1; hj definition, u^^^ = 0; 

• Pf V) ■.= nmm{n,j + l)6k,i + Qj{iy^''-^'')-2Qj{u'^''^)+Qj{iy^''+^'>) > 0, for all k,] > 1. 
By definition, these two conditions mean that the configuration u is admissible of type 

((n^); ((n — 1)", 1")), i.e. belongs to the set of admissible configurations C((n^); ((ri— 1)", 1")). 
Recall, that notation {{n — 1)", 1") stands for the partition (n — 1, . . . , n — 1, 1, . . . , 1). 

n n 

• By definition, for any partition z/, Qj^u) = ^^min(j; Ua) is equal to the number of boxes 
in the first j columns of the diagram corresponding to partition u, and mj{v) = Uj — v'j^i is 
equal to the number of parts of partition v of size j. 

Secondly, the symbol c(z/) stands for the charge of configuration z/, i.e. 



c z/ 



j>l ^ ^ k>2,j>l ^ 



b. Deduce from identity ( |7.11D yet another combinatorial formula for Catalan numbers: 
(2n)! 



E n 

/3l-(n2-n) k=l 



" ' ' {2k+l)n-2k-2{[3, + --- + f3k)+f3k-f3k+i 



k+l 



summed over all partitions /3 = [Pi > /?2 > • • ■ > Pn) of n"^ — n, such that for all fc, 1 < < n, 
the following inequalities hold 

k{n-l) <P, + --- + Pk< ^ii2k + l)n -2k- n^.n)). (7.12) 
The sum (/^A,(i")(q'))^ gives a new g-analog of the Catalan numbers which is different 

Z(A)<2 

from those of Carlitz and Riordan 
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If p = 3, the RHS( [7!TTD with q = 1 gives rise to a combinatorial formula for the number 



of vexillary permutations (see, e.g. |5T|, Definition (1.27)) in the symmetric group Sn- 
2. (Kostant partition function) 
a. Let 

S c $(r) = {(i, j) G I 1 < i < J < n} 

be a subset of the set of all positive roots of type An-i- The g-analog of Kostant partition 
function -^'^(t; q) is defined via the decomposition 



X ' 



(7.13) 



summed over all sequences of integers 7 = (71,72, • • • ,7n) G Z", I7I = 0. In other words, 
-^2(7; q) is the generating function for the number of ways of forming 7 as linear combinations 
of elements of E with non-negative integer coefficients: 

where the sum is taken over all sequences of non-negative integers {mij}, G S, such 

that 

J2 mijCij = 7, 

where the vector Cij G Z" has the following components {eij)k = ^ik — Sjk, ^ ^ k < n; 



m\\= J2 



rriij. 



i) Show that i^'$(in)(7; 1) 7^ 0, if and only if 

7 G y„ = I (1/1, ...,?/„) G Z 
a) Show that 



2/1 H \-yj>0, if 1 < j < ^, 

2/1 H K 2/n = 



(7.14) 



Remark 7.20 E r] = (1"), then 

and ii'$(in)(7; g) coincides with the g-analog of type A Kostant partition function P{'y,q). 
In this case the RHS (|7.14|) takes the form 

J2 e{w)Piwi\ + 5)-ix-5;q). 



This sum is equal to the Kostka-Foulkes polynomial K\^{q), see e.g. [^. Chapter III, §6, 
Example 4. 
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iii) Let 7 G and be an integer such that + 7n > 0. Consider partitions Xn = 
N{n, n — 1, . . . , 2, 1) + 7, /i^r = N{n, n — 1, ... ,2,1), and composition r], \ri\ = n. Show that 

(q). (7.15) 

b. Let 

7 e y+ = {7 G Y^l^i > 0, 1 < z < n - 1}, n > 3, 
and 7] = (l"-2,2). Show that 

^*(i")(7; 1) = ^(71 H H 7n-3 + 37„_2 + 3)ir$(^)(7; 1). (7.16) 

Statement that the LHS( |7.16|) is divisible by the hnear factor 

^n(7) := 7l + 72 H \- 7n-3 + ^ln~2 + 3 

was first observed by J.R. Schmidt and A.M. Bincer, J. Math. Phys. 26 (1984), 2367-2373, 
see also ||35|. In |^ we obtained also an explicit expression for the ratio 3-ft'$(in)(7; l)//„(7), 
from which one can see that the latter can be identified with the parabolic Kostant partition 
function -ft'$(i"-2,2)(7; !)• 

c. Consider vector 

7 = 7d,n = {d,d+l,...,d + n-l, -n{2d + n- l)/2) G 
and composition 77^ = (l'^, n — k,l). Show that 

■^\ TJr TT 2(n-fc) + - 1 -pr 2d + i+j-l 
p=i i<i<j<k ■' {i,j)€nk,n ■' 

where Vtk^n = $(1"+^) \ and S^.^^ = 

r,. ..,k . . 2n-k + 4:.. Jk + l + 2a /c + 3 + 2aV^ ^ ^ 
{{i,3)\- <i<3< ^ } \ { ( ^ , ^ ) |0 < a < n - fc}. 

In particular, 

i^$(i"+^)(7.,n;i) = n^^' n _ i . (7-18) 
^*(..)(7i,n;i) = i{cp n 

p=l l<i<j<fc+l 

(2m)! 

where Cm '■= — tt rr denotes the m-th Catalan number. 

m\[m + 1)! 
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l<i<j<n 

J, 



-T-r 2d + i + J — 1 

By a theorem of Proctor |E7f, the product |T is equal to the number 



pp "^{d) of (weak) plane partitions of staircase shape 5„ = (ra — 1, n — 2, . . . , 2, 1) whose parts 
do not exceed d. For example, if n = 3, there exist 5 plane partitions of shape 63 = (2, 1) 

who.e parts do not exceed 1. Namely, plane partitio,. p " ' ' ' T ' T ' J ' ' 

More generally, it is not difficult to see that 

l<i<j<n 



is equal to the n-th Catalan number, and 



k 



d. Combinatorial interpretation of identities (|7.18 ) and ( [7.19|) . 

• Let 7 G F„, and 77 be a composition of n. Denote by SM^{'^) the set of n by n 
skew-symmetric integer matrices m = (m^j) such that 

i) rriij > 0, if (i,j) G $(77); 

ii) m,, =0, if (2,j)G$(l")\$(r/); 

iii) = 7i, l<i<n. 
It is clear that 

|^M,(7)|=i^$(,)(7;l). 

• Denote by Cat{n) the set of lattice paths from (0,0) to (n(n + 1),0) with steps (1, 1) 
and (1, —1) never falling below the x-axis and passing through the points Pk = {k{k + 1), 0), 
k = 0,1, . . . ,n. It is clear that the number of elements in the set Cat{n) is equal to the 
product of the first n Catalan numbers C1C2 ■ ■ ■ Cn- 

• Denote by PPn{d) the set of (weak) plane partitions of staircase shape (5„ whose parts 
do not exceed d. 

Construct bijections 

^M(in)(7rf,„_i) ~ Cat{n-2)x PP^_^{d), (7.22) 
5M(i.,„_fc)(7i,„_i) ~ Cat{k)xPPk+i{n-k-l). (7.23) 

e. Let n > 3, consider vector 

Pd,n = id,0,l,...,n-3,-d-in-2){n- 3)/2). 

Show that 
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Problem 7.21 Find a q-analog of identity ^7.d( j, i.e. to define a statistics L on the set 
S'M(in)(7rf „_i) with the generating function 

"-2 _ 2d+i+j-l 

nc'(2.pi«) n 1 ' ..,-1 ■ 

which is agree with the decomposition ( [7. 22j . 
Here 



C(2,m|g):= ^ ^ 



1 - 



2m 
m 



denotes "the most obvious" g-analog of the Catalan number Cm, see Section Exercise la. 
f. Show that 

i) there exists a unique continuous piece wise polynomial function V^(rf){yi, ■ ■ ■ , y-n) on the 
cone Yn such that its restriction to the set F„ fl Z" of integer points of the cone coincides 
with the Kostant partition function 

'P'S>(v)i*)\y^nZ" = 1). 

Polynomiality domains of the continuous piecewise polynomial function . . . , ?/„) de- 

fine a subdivision of the cone Yn into convex integral polyhedron cones. 

Question. For given t] and n what is the minimal number r„(?7) of polynomiality domains 
of the function . . . , ?/„)? For example, 

r2((l2)) = 2, r,{{l')) = 7, r,{{l')) = 48. 

ii) the restriction of the function to the dominant chamber is a polynomial in 
the variables yi, . . . , yn-2- 

f n — 1 \ 

iii) The homogeneous degree I component V^^^{y) of the polynomial 



• • • , 2/n)|y+ has the following form 



n-2 



VT'^iy) = E - n + 2, /2 - n + 3, . . . , /„_2 - 1) H TT 



i=l 



summed over all (n — 2)-tuples of non-negative integers (/i, . . . , /n-2) such that 
• li + --- + lk>kn- M^l±^^ 1 < A; < n - 2, 
./+ +/ _ {n-l){n-2) 

Conjecture 7.22 If vector '-y G Z" belongs to the cone (the so-called dominant chamber) 

y+ = {(yi, ...,!/„)€ > 0, . . . ,?/„_i > 0}, 
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then the normalized Kostant partition function 

^ ^ ' !ir<i,(in)(7; 1) 

negative integer coefficients. 

Conjecture 7.23 -R'$(^)(7;g) is a unimodal polynomial in the variable q. 
g. Show that 

n+d-2 



RHS(7.18) = n^Ca/M' (7-25) 

j=d 

j=n—k ^ ^ 

h. (Chan-Robbins polytope) 
Let A = (Ai, . . . , A„) and fi = (/ii, . . . , fin) be compositions of the same size, without zero 
components, and such that 

/ii + ■ • • + /ii+i > Ai + ■ ■ ■ + Aj for all 1 < i < n — 1. 

Let CR^^ be the convex polytope in M"^ of all points x = {xij)i<ij<n satisfying the following 
conditions 

• Xij = 0, if j > i + 1; 

• ^ij = -^i) Y2i -^ij ~ l^j- 

This is an integral polytope (i.e. all vertices of the polytope CR^'^ have integer coordi- 
nates) of dimension ^ 2 ^ ' '^^^ polytope 

CRn := CRP'^'"^ 

was introduced and studied by Chan and Robbins and Chan, Robbins and Yuen It is 

a face of dimension ^ 2 ^ with 2""^ vertices of the Birkhoff polytope see Example [7.19 . 

We will call the polytope CRn by Chan-Robbins polytope. 
i) Show that if A; is a positive integer, then 



i(Ci?^'^; k) = #|Ci?f n ZV 2 ; I (7.27) 
= K^^in+i){kfii, k{fi2 - Ai), . . . , k{fin - K-i), -kXn, !)• 
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n 



(Hint: it is enough to consider the case k = 1. If (xij) G CR^^ fl Zv ^ / , then 

l<i<j<n 

and the upper triangular matrix 

(mij) := {xij_i), l<^<J<n + l, 
defines an element of the set 

S'M$(in+i)(/ii, /i2 — Ai, . . . , /i„ — Xn~i, — A„). 

Conversely, if 

{rriij) G S'M$(in+i)(/ii,/i2 - Ai, . . . ,/i„ - A„_i, -A„), 

then the point x = (xjj)i<jj<„, where Xij = ""^j-i.i if j < + 1, and Xij = 0, if j > i + 1, 
belongs to the polytope CR^^.) 

Denote by • • • Un+i) a unique continuous piecewise polynomial function on the 

cone Yn+i such that 

'P<i>(i"+i)(»)|y„+inz"+i = -^<i>(i"+i)(»; 1), 

see ||3^, or Exercise f to this Section, 
ii) Show that 

£(Ci?^^; t) = t(/i2 - Ai), . . . , t{fin - A„-i), -tA„), (7.28) 

where £{CR^'^;t) denotes the Ehrhart polynomial of the polytope CR^^^. 
In particular, for the Chan-Robbins polytope one has 

^(Ci?„; t) = P$(in+i)(t, 0, . . . , 0, -t). (7.29) 



n-l 



Deduce from (|7.29|) and Exercise 2f, iii) to Section 7, that 



n-2 



voi(Ci?„+0 = n TTI ( T ) ^^-2°) 

is the product of the first n — 1 Catalan numbers. Formula (|7.3CI| ) for the normalized volume 
of the Chan-Robbins polytope CRn was stated as a conjecture by Chan and Robbins 0, 
and has been proved by Zeilberger |]72 . 



i. Suppose that n > 3 is an integer and that 2<s<r<n — 1. Follow [§] denote by 
P„(r, s) the integral convex polytope 

Pn{r,s) := n = 0}. 

Denote by p„(r, s) the normalized volume of the polytope Pn{r, s). 
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Show that 

• pn{r, 2) = i^$(in-i)(7^""^^; 1), where 
7r^)=(l,2,...,n-2,-^I^^i^^)- i p^.'.'y.O) , 2<r<n-l; 

n-1 

• pn{r, s) = pn{r, 2) - pn{s - 1,2), 2 < s < r < u - 1] 

• pn{r, 2) + pn{n - r, 2) = -1,2), 

Pn{r,2) = pn{n — l,n — r + 1), 2 < r < n — 1 , 
where by definition we put Pn{T, s) = 0, if r < s. 

3. (Gclfand-Tsethn polytope) Let A = (Ai > A2 > ■ ■ ■ > > A^+i — 0) and = {/ii > 
//2 > ■ ■ ■ > /Us > 0) be partitions such that X> /i with respect to the dominance order. 

a. Show that 

dimG(A,/x) = (r-l)(5-l)-(2)-E 

^ ^ i=i 

b. Denote by a(A, /x) the lowest degree of q which is present in Kx^{q), i.e., 

= /x)g"^'^'''^(l + higher degree terms). 
Show that if n e Z>i, then 

a{n\, n/i) — na{X, /i). 
Conjecture 7.24 Generating function 

n>0 

is a rational function of the form Q\^{t)/{1 — where r{\, ji) E Z>o, and Q\^{t) is 

a polynomial of degree < r(A, /x) with non-negative integer coefficients. More generally, 

J2 E ^((^^ - 1)^' (^^ - mt'-'z^-' = Q,,(t, z)/({i -t){i- z))'-(^'^)+\ 

k>l n>l 

where 

Q\t,{z,t) = Qx,j,{t,z) 
is a polynomial with non-negative integer coefficients. 
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Example 7.25 Take A = (7432) and /i = (4432111). Then dimG{X, fi) = 12, a{nX,nij,) 
5n, and 

'n + 3\ f n + A 
4 j + I 4 



6(nA, njj) 
Hence, 



n>0 ^ ' 

Qx^,it, z) = l + z + {l + 15z + 6z^)t + {6z + Ihz^ + z^)t^ + (^^ + ^3^)^3_ 

c. Show that for any n,m & Z>0) 

-K'(72-|-jrt)A,(n+m)/i (•?) ^ -^nA,n/i('?)-^mA,m/x (Q') • 

d. Let T be an integral convex polytope in M'^ of dimension d. Show that 

r r 

■ ■ ■ - 1) n = Qyit^^ • • • ' ^^0/ - ^^•)''"'' 

fci,fe2,...,A;r>l J=l i=l 

where (^^(ti, . . . ,tr.) is a polynomial in the variables ti, . . . ,tr with integer coefficients. It 
looks an interesting combinatorial problem to describe all integral convex polytopes 9 such 
that the corresponding polynomial Q'j>{ti,t2) has non-negative integer coefficients. 
Question. Does there exist an integral convex polytope r(A, fi) such that 

i(r(A, fi);k) = h{k\, k^), 

for all integers > 1? If so, is it true that in this case r(A,/i) = r(/i'. A')? 

e. (MacMahon polytope and Narayana numbers again) 

Take A = {n + k,n,n — 1, . . . ,2) and = A' = (n, n, — 1, n — 2, . . . , 2, 1^). Show that if 
n > k > 1, then for any positive integer N 

• a{NX,Nfi) = {2k-l)N; 

k—l n— fc+1 

.6(A'A,A.,)=d,mi.»r.:';A=n n ■ 

i=i j=i ^ ■> 

In other words, b{NX, Nfi) is equal to the number of (weak) plane partitions of rectangular 
shape ((n — k + 1)^~^) whose parts do not exceed A^. According to Exercise 1, c. Section |, 
b{NX, N^) is equal also to the number i{dJlk-i,n-k+i', N) of rational points x in the MacMahon 
polytope Tlk-i,n~k+i such that the points A^x have integer coordinates. Therefore, in this 
example one can take 

r(A,/i) = Tlk-l,n-k+l- 



It follows from (|2.23|) that the generating function for numbers b{nX, njj) has the following 
form 

/(fc_2)(„-fc) \ 

b{nX, nfi)r = J2 N{k-l,n-k + l; j)t^ /(I - tYk-i){n-k+i)+i ^ 

n>0 Y j=0 J 
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where N{k,n;j), < j < {k — l){n — 1), denote rectangular Narayana's numbers, see 
Section ||, Exercise 1. 

f n + 2 \ 

• Show that if r := A; — ( ^ 1^0? then 6(A, /i) = 1, and 

a(A,/i) = 2(^'' + ^^+(n + l)(2r-l)+(^2 
n + 2 \ 

if 1 < < ( , then there exists a unique p, 1 < p < n, such that 



2 

(p- l)(2n-p + 4)/2 < /c <p(2n-p + 3)/2. 

In this case 

a{X, fi) = p{2k - {p - l)n ~ p) + 2 ^ 

and one can take r(A,/i) to be equal to the MacMahon polytope Mr{k),s{k) with r{k) := 
k-l - (p - l)(2r2 - p + 4)/2, and s{k) := p{2n - p + 3) /2 - k. 

This Exercise gives some flavor how intricate the piecewise linear function a{X, fi) may 

be. 

4. (Generalized saturation conjecture) 

a. For any partition A and a dominant sequence of rectangular shape partitions R = 
{i.f^a'))a=i define the numbers a{X,R) and b{X,R) via decomposition 

K\R{q) = 6(A, R)q"'^^'^^ + higher degree terms. 

For any non-negative integer n denote by nR the dominant sequence of rectangular shape 
partitions 

nR := ((n/xj^^. 

Conjecture 7.26 (Generalized saturation conjecture) 

a{nX, nR) = na{X, R). 

Conjecture 7.27 i) (Generalized Fulton's conjecture) Ifb{X,R) = 1, then 

b{nX, nR) = 1 

for any non-negative integer n; conversely, if b{nX,nR) = 1 for some positive integer n, then 
b{X,R) = 1. 

a) More precisely, there exist non-negative integers d and Oq, ai, . . . , (depending on X 
and R) such that Oq = 1, and 



d , 
b{nX, nR) = i 

k=0 ^ 



n + k 
d 



for all n > 0. Moreover, b{nX,nR) is a polynomial in n with non-negative rational coeffi- 
cients. 
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Therefore, if b{nX,nR) = 1 for some non-negative integer n, then d = and oq = 1, and 
so b{NX, Nfi) = 1 for all non-negative integers A^. 

Recall that Fulton's conjecture says that a condition c^^ = 1 is equivalent to c^x^Nfi being 
one for any N eN, see e.g., A. Buch (Enseign. Math. (2) 46 (2000), 43-60). 

It is well-known that weight multiplicities dim Va(/u) = Kx^j^ may be considered as a limit- 
ing case of the Littlewood-Richardson numbers, i.e. the triple tensor product multiplicities. 
The Fulton conjecture is a far generalization of the following (well-known) fact: 

Let A and fi be partitions, then Kx^ = ^ if and only if KnX,nfi = 1 for all positive integers 

n. 

This fact is a simple corollary of the Berenstein-Zelevinsky weight-multiplicity-one crite- 
ria, see e.g., A. Berenstein and A. Zelevinsky (Functional Anal. Appl. 24 (1990), 259-269), 
A.N. Kirillov, Generalization of the Gale-Ryser theorem, European Journ. of Combinatorics, 
21 (2000), 1047-1055, or R. Stanley |6|], Exercise 7.13, p.451. 



Conjecture 7.28 

i) a{X, jj) = a{jj',X'); 

ii) b{X,fi) = b{fi',X'). 

Conjecture [7.28| , i) was stated by I. Macdonald Chapter III, §6, Example 3 on p. 243. 



Conjecture 7.28 , ii) was stated for the first time in |^|, see also 



Let us explain briefly why Conjecture [7.26| may be considered as a generalization of 



saturation conjecture. First of all, let us recall a formulation of the saturation conjecture 
(now theorem due to A. Knutson and T. Tao, J. Amer. Math. Soc. 12 (1999), 1055-1090): 
Let X, /i, u be partitions, denote by c\ ^ ^he corresponding Littlewood-Richardson number, 

i.e. 

cl^ = Mn\i[V,:Vx®V^]. 
If for some non-negative integer N one has c'^xn^i ~ 0? then Cx^ = 0- 

It was first shown in 1994 by A. Klyachko (Selecta Math. 4 (1998), 419-445) that the 
saturation conjecture implies the Horn conjecture about eigenvalues of a sum of two Hermitian 
matrices (A. Horn, Pacific Journ. Math. 12 (1962), 225-241). We refer the reader to survey 
articles by W. Fulton (Bull. Amer. Math. Soc. 37 (2000), 209-249; Seminaire Bourbaki, 
vol. 1997/98, Asterisque No.252 (1998), Exp. No.845, 255-269) for historical overview, 
description and solution of Horn's problem, and explanation of connections between Horn's 
and saturation conjectures. 

Finally, let us show how the saturation conjecture follows from Conjecture 7.26 . First of 
all, according to Exercise 3, Section ^, if X, fi, v be partitions, then 

^xrWi ~ g'^^i'-'^^^''^' {cx^fj, + higher degree terms} . 

Therefore, if c^x^nim some positive integer A^, then 

a{NX,NR) = QNxANiy) - \NX\ = ^ min(ArA, ATz/J - iV|A| = N{QxAi^) - |A|), 
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and therefore, ^ ^ 

a{\,R)=Qx,{i^)-\X\. 

The latter equaUty means that c^^ ^ 0. Similarly one can show that if c^^ ^ then 
^N\,Nix 7^ f*^^ positive integer A^. 

■ 

As a byproduct, we obtain a criteria telling when the Littlewood-Richardson number 
^u/j. 0- Namely, let A, u be partitions such that \u\ — |A| + 1{X) < p, < s. Define 
partition 

A = (Ai + ^1, Ai + fj,2, . . . , Ai + fig, Ai, . . . , Ap) 

and a dominant rearrangement of the sequence of rectangular shape partitions {v, (AJ)}. 
Then c^^ 7^ if and only if 

a{A,R) = Q,,{iy)-\\\, 
and if the latter equality holds, then 

c^,,^b{A,R). 

In order this criteria happened to be really effective, one has to know a direct combinatorial 
interpretation of the numbers a(A, R). 

Remark 7.29 More generally, for any two partitions A and n of the same size, and a com- 
position 77, such that \ri\ > l{fj.), one can define the numbers a{X,fi;r]) and b{X,n;ri) via the 
decomposition 

Kxhv{q) = A*; + higher degree terms. 

It is natural to suggest the following 

Conjecture 7.30 i) a{nX,nii;ri) = na{X, iJ,;ri); 

ii) h{nX,nix]ri) is a polynomial in n with non-negative rational coefficients; 
Hi) b{nX, n/x; ^7) = 1 for some positive integer n if and only if b{X. fj,; rj) — 1; 

iv) assume additionally that \ri\ > Xi, then a{X,fi;ri) = a{fi' , X' ; rj) ; 

v) the generating function X]n>o b{nX^ nfi; ri)t'^ is a rational function in t of the form 
Pxnr]{t)/{^ — where r^XjjbVi) e Z>o and Px^^{t) is a polynomial of degree < r{XiJ,ri) 
with non-negative integer coefficients. 

Let us remark that in general 

b(X,i,;rj)^b(i,',X';rj). 

For example, take 

A = (7654321), //=(4^2,l6) and 77 = (4, 1, 1, 2, 4). 
Then /x' = (12, 6, 5, 5) and Kx^r,{q) = q%5, 17, 24, 17, 5), but 

i^^'A',(g) = g'(l,l,l). 
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b. Let A,/i and v be partitions. Show that 

a(A \ v^\i\ v) < a(A, /x), 

and if /(z/) < /(A), then 

a{X + u, + u) = a(A,/i), 
6(A + I/, + z/) > 6(A,/i). 

See also Exercise 1 at the end of Section ^. 

Problem 7.31 Show that a{X,R) and a{X,fi;T]) are (continious) piecewise linear functions 
of A and R, and A, /x and rj correspondingly, and compute these functions explicitly. 

c. Let A,/i be partitions and i/ be a composition such that both A + z/ and fi + i' are 
partitions. Show that 

a(A + u, fi + u) < a(A, /i), 

and if /(z/) < /(A), then 

a(A + z/, + z/) = a(A, /i). 
Note that in the case under consideration the difference 

(g) - Kx,M 

may have negative coefficients. However, it looks plausible that all coefficients of the latter 
difference have the same sign. 

d. (Geometrical interpretation of Conjecture [7.28| ) Let A and /i be partitions of the same 
size, such that A > /i, and N be an integer. Follow consider the compact convex 
polytope r^^)(A,/i) in of all points x = {xij)i<i^j<N satisfying the following conditions 

i) ^ ^ -Cjj Aj, Si -^ij 

j 

ii) '^{xkj - Xk+i,j) > and Y.i>k+ii^in - Xi,n+i) > for all integers k,n>l. 



We will call this polytope by configurations polytope. One can show Section 5, 
that the set of integer points T'^\X, jj,) of the configuration polytope is in one-to-one cor- 
respondence with the set C{X;ji) of admissible configurations of type (A;/i). Therefore, 
t'^^\X, /i) 7^ if and only if A > /x. 

For any x G let us set 

c(x) = 

and define 

a(A,/i) = min{c(x) | x G T^^\X., jj)} . 

It easy to see that 

a{X,^i) = -{a{X,fi) - |A|). 
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Finally consider the convex set 

ri^)(A,/i) = {xer«(A,/i) I c(x) = a(A,/i)}. 

• Show that 

|r«(A,/^)nz^VKA,/x). 

On the other hand, consider the compact convex polytope T^'^\\, jj.) in of all points 
X = {xij)i<ij<N satisfying the following conditions 

i) ^ij ~ At, Yli^ij ~ ^j'l 

j 

ii) ^(xfcj - Xk+i,j) < \k- Afc+i and Y^i^^+ii^in - Xi,n+i) < yu'„ - yu'„+i for all k,n>l. 

j<n 

• Show that the set T^^\X, jj) of integer points of the polytope r(^)(A,/i) is in one-to- 
one correspondence with the set C{fi', ; A') of admissible configurations of type (/i'; A'), and 
construct such correspondence explicitly. 

Finally, consider the convex set 

rJ^)(A,/i) = {x G r(2)(A,/i) I c(x) =H(A,/i)}. 

Conjecture [7.28| is equivalent to the following statements 

• a(/i'. A') := min{c(x)|x G F^ (A, = a(A, 

. |F(')(A,/x)nz^VKA,/i). 

5. Let A be a partition and i? be a dominant sequence of rectangular shape partitions 
i) Show that the generating function 

ra>0 

is a rational function in q and t, say. 



Q\R{(l,t) 



where the numerator NxR{q,t) and the denominator D\R{q,t) are suppose to be mutually 
prime. 

ii) Let A and R be as in i). Show that there exists the limit of cocharge parabolic Kostka 
polynomials 

lim Kn\,nRiq), 
n— >oo 

where by definition 

KxRiq) = q^^'^KxRiq-'). 
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Conjecture 7.32 i) The denominator of the rational function Q\R{q,t) has a product form 

D^n{q,t) = l[{l-q^t)''^ 

for some finite set of non-negative integers {/cj^, . . . , kj^}; 

a) ifb{X,R) = 1, then there exists the limit of normalized parabolic Kostka polynomials 

lim g-""("'^)ir„A,„/?(g); 

n— >oo 

Hi) the generating function X]n>o -^"^:"^(-'-)^" ^ rational function in t of the form 

(1 _ i)d(A,R)+l ' 

where d{X,R) G Z>o, P\r{1) ^ 0, and PxR{t) is a polynomial with non-negative integer 
coefficients. 



Problem 7.33 i) Find combinatorial inerpretation(s) for the number b{X,R) in terms of 
objects similar to either the Berenstein-Zelevinsky triangles j^, or the Knutson-Tao honey- 
combs and hives (A. Knutson and T. Tao, [ibid\; A. Buch, Enseign. Math. (2) 46 (2000), 
43-60), or the Gleiser-Postnikov web functions (O. Gleizer and A. Postnikov, Item. Math. 
Res. Notes 14 (2000), 741-774), or domino tableaux (see e.g., C. Carre and B. Leclerc, Journ. 
Alg. Comb. 4 (1995), 201-231). 

a) Find a q-analog of numbers 6(A, R) which generalizes the q-analog c\^{q) of Littlewood- 
Richardson's numbers introduced by C. Carre and B. Leclerc [ibid]. 

Hi) When does the number b{X, R) equal to 1 ? 



Examples 7.34 1) Take A = (4422) and R = (3, 3, (2, 2), 1, 1). Then 

(n\f- - {l + q'm + qH) 

2_^KnX,nRt - 77—p)6- 

n>0 ^ ^ 

Note that in this case a(A, R) = 2 and b{X, R) = 1, 

KxRiq) = g'(11411). 
2) Take A = (52) and /i = (2221). Then 

l + q^t + qH 

'^nX,nfi{q)^ = 7^ 

n>0 



(n\i- - l + q't + qH 

L./-^'-^^^)' il-qH)il-qH){l-q^y 



Z^^nX,nfj.l^ - (l_-j.\3- 
n>0 ^ ' 
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Note that in this case a(A, /x) = 4 and b{\, jj) = 1. 
3) Take A = (422) and = (22211). Then 



^ l + {q^ + q^ + q^)t - {q^ + + q^^)t' - q^H' 



- 1 + 4* + *' 



n>0 



{i-ty 



Note that in this case a(A, /x) = 3 and 6(A, /x) = 2. 
4) Take A = (732) and n = (432111). Then 



^ „ _ 1 + 34t + 189t2 + 228t-'^ + 57^^ + 2t^ 



n>0 



[1-ty 



Here a(A, //) = 5 and fo(A, //) = 3, since Kx^{q) = q^{S, 7, 9, 9, 7, 4, 2, 1). 

It is not difficult to check that the Gclfand-Tsethn polytope G(A, //) is an integral one, 
and its normalized volume is equal to 511. 

5) Take A = (44), = (1^). Then 

Nx^.{q,t) 



where 



KnX,n^l{q) (n i\' 



NxM^t) = l + g^^(l + g + g' + g'^ + g^ + g^ + g6)(t-g^3^^) 

+ g^^(l + q + q^ + q^ + 2q'^ + 2q^ + 2q^ + q'^ + q^ 

+ q^ + q^''){e - q^H^) - q^H''- 

D,,{q,t) = {l-q^h){l-q'H){l-q'H){l-q'H){l-q'H) 

■ {l-q^h){l-q^H)- 

^ _ 1 + 8t + 22^^ + + 

n>0 ^ ' 

In this example 

Kx^,{q) = g^^(1011212121101), 

dim G{X,fi) = 5, and the normalized volume vol G{X, /j.) = 40. 
6) Take A = (333), = (1^). Then 

^ n _ 1+ 31^+ 469^2+ 2113iH 3466t^+ 2113^^+ 469^^+ 3lf+ f 



n>0 



In this example, Kx^ — 42, a(A,/x) = 9, 6(A, /x) = 1, dim G(A,/x) = 10. It is not difficult 
to check that the Gelfand-Tsetlin polytope G(A, //) is an integral one, and its normahzed 
volume is equal to 8694. 
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7) Take A = (52^1), fi = (2^). One can check that there exists only one admissible 
configuration of type (A;/i), i.e. |C(A;/x)| = 1. On the other hand |C(2A;2/i)| = 2. This 
observation shows that in the case under consideration the configurations polytope T^^\\, fx) 
cannot be an integral polytope, but only a rational one. 

It is not difficult to check that 



4n 



' 2n + A' 




' n + 3' 


3 


g 


3 



1 - 
l-g4 ' 



1 + 32t + 128^2 + 104t3 + 15^4 



n>0 



Therefore, dim G{X, fi) 



7, ^G{X,n) = 280, and 



E 

n>0 



6. Example of a convex integral polytope such that its Ehrhart's polynomial has negative 
integer coefficient. 

a. Let Tr C be the tetrahedron whose vertices are the points (0,0,0), (1,0,0), (0,1,0) 
and (1, l,r), where r is a positive integer. 

Show that 

• £{Tr; t) = {rt^ + 6t2 + (12 - r)t + 6)/6; 

■ -l ^ ,n 1 + - 1)^' 

A'^r]n)t = — 

Hence, the tetrahedron r,. contains no lattice points other than its vertices, has volume r/6, 
and if r > 12, then the Ehrhart polynomial £{Tr\t) has negative coefficient. Note that the 
5-vector of the tetrahedron is equal to (1, 0, r — 1), which is not unimodal. 

This example is due to J. Reeve (Proc. London Math. Soc. 7 (1957), 378-395). Note 
also, see [^, p. Ill, that there exists an integral simplex A C M*^ of dimension 8, which 
satisfies the condition (A — d/S) fl 7^ 0, and such that its 5-vector is equal to 5(A) = 
(1, 8, 15, 13, 15, 14, 14, 14, 5), which is not unimodal. 

Question. Is it true or not that if the (5-vector of a convex integral polytope V is unimodal, 
then the Ehrhart polynomial £{V\ t) of the polytope V has non-negative integer coefficients? 

b. Compute the Ehrhart polynomial and (5-vector of the simplex in the space M*^ with 
the following vertices 

,0),ei, . . . ,erf_i, (1, . . . , l,r). 



(0,. 



d-l 



nil; ^ 



where = (eifc)^^^ and Cik = Si^k- 
7. Let A be a partition, A = (p™S 

Denote by Yk{X) the convex (non-compact) polyhedron in 
satisfying the following conditions 

• 1/1 + ■ ■ ■ + 1/i > for all integers i, I < i < k; 

• —^i < 1/i < Pi-i — Pi for all integers i, 2 < i < k; 



where pi > p2 > ■ ■ ■ > Pk > and each > 1. 

''+^ of all points y = (?/i, . . . , y^+i) 
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• 1/1 H h Uk+i = 0. 

i) Show that the set of integer points of the polyhedron Yk{X) is in one-to-one correspon- 
dence with the set of vexillary permutations w G 5*00 of shape X{w) = X. 

ii) Denote by Yk{X; n) the convex polytope in M.^~^^ of all points y G ^^(A) that additionally 
satisfy the following condition 



Pi + yi-\ h + mi H \-mi <n 



for all integers i, 1 < i < k. 

Show that the number of integer points of the (rational) polytope Yk{X; n) is equal to the 



number of vexillary permutation w G 5"^ of shape X{w) = X. We refer the reader to |5l 
Chapter I, for definition and basic properties of vexillary permutations. Note that formula 
( 7.11|) with p = 3 gives an explicit combinatorial expression for the number of vexillary 



permutations in the symmetric group Sn- 

8. Let P{q) be a polynomial with non-negative integer coefficients. 

i) Show that there exists a non-negative integer N, depending on P{q), such that the 
product (1 + q)^P{q) is a unimodal polynomial. 

We denote by ud{P) the least non-negative integer with this property. 

ii) Show that if n > 2, then 

ud{l + g") =n^-3. 



8 Stable behavior of Kostka— Foulkes polynomials 

Given partitions a and (3 with /(a) + /(/3) < n, define 

as the Cartan piece mVa<S) V^, i.e. the irreducible 0/(ra)-submodule generated by the tensor 
product of the highest weight vectors in each factor. It is well-known that vj^^^ = v]^'^ for 

7 := [a,p]n = (ai + Pi, ■ ■ . , ar + Pi, Pi, ■ , Pi , Pi - ps, ■ ■ ■ , Pi - P2), 

n—r—s 

where r = /(a) and s = 1{P). For example, 

^(o)\o) ~ ^(i)'(i) ~ ^ '-^^^ adjoint representation). 

In Sections | and | we had investigated the properties of the mixed tensor representations 
V[q,_/3],^ and their zero-weight subspaces. In this Section we are going to study the stable 
behaviour of more general families of weight subspaces in Vja^/jj^. 

Let A,/i, 1/ be partitions, |A| = consider a family of partitions A„ := A © z/" and 
/Xn := fi ® i^"'. Recall that if A and fi be partitions, then A © denotes the partition whose 
parts are those of A and /i, arranged in descending order, and /x©z/" = /i©z/©---©z/. 
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Proposition 8.1 ([^|3^) i) The number ^\C{Xn, fJ'n)\ of admissible configurations of type 
[Xn] Hn) is finite and independent on n if n is big enough, 
a) ("Gupta conjecture") lfn>0, then 

i^A„+i,^.„+i(g) > Kx„,,.„il), (8-1) 

i.e. the difference ii'A„+i,^f„+i(Q') — -^a„,^j„(q') is a polynomial with non-negative integer coeffi- 
cients. 

Hi) There exist the limits 

lim¥,„,^„(g) = 

n— >oo 

which are rational functions of q. 



Remark 8.2 The statement ii) of Proposition |8.1| was stated as a conjecture by Gupta |21|1 , 
and lias been proved by G.-N. Han |22], and A.N. Kirillov |30]. Tlie proof given in |22| was 
based on the explicit combinatorial construction of an embedding 

STY{X, fi) ^ STY{X © (a), /X © (a)) 

of the set STY{X,fi) of semistandard Young tableaux of shape A and weight fi to that 
STY{X © (a),/i © (a)) of semistandard tableaux of shape A © (a) and weight fi © (a). The 
proof given in [30| was based on the theory of rigged configurations. It is still an open 
question whether or not a bijection constructed by G.-N. Han is compatible with the 
rigged configurations bijection. 

We are going to describe the rational functions Z^^{q) and Y^^{q) in a particular case 
when the partition u consists of one part, namely, u = (a). 

Without lost of generality, one can assume that partitions A and fi have the following 
forms 



,a,a — I3s,a — (5; 



a - (3i) 



X = {ai + a, . . . , + a, a, . . . , ^, , 

k—r—s 

At = (71 + g, . . . ,7z + a, a, . ,a^ ,a- 6p,a - (5p_i, . . . ,a - 

k—l—p 



(8.2) 
(8.3) 



where a = (ai, . . . , a^), /5 = (/3i, . . . , /?s), 7 = (71, . . . , 7z), and S = {Si,. 
such that |a| + \6\ = \p\ + I7I, /(a) + /(/?) = ^(7) + l{6) > k. 

We start with a study of the simplest case when 7 = 5 = 0, i.e. /i 
one can use Corollaries and ^]7| to conclude that 



, Sp) are partitions 
(a^). In this case 



lim K 



Affi(a"),(a"+'=) 



(g) = lim Sa * sp{q, ...,q 



n+k-l\ 
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where a = ((Ai — a)+, (A2 — a)+, ...),/? = ((a — Xk)+, (a — Xk-i)+, ■ ■ ■), and the symbol (a)+ 
stands for max(a, 0). 

The principal specialization Sq, * S/3(l, g, g^, . . .) has been computed by Stanley Com- 
bining with p2|, Chapter VI, §8, Exercise 3, the Stanley result may be stated as follows 



2 N_^/3a(g,g) 



Sa*sp{l,q,q ,...) 

Ha{q) 

Summarizing, we obtain the following result 



lim irAe(a"),K+'=)(g) = q\-\^S^^^ (8.4) 

where Ha{q) denotes the hook polynomial, see e.g. ||52[, Chapter I, §3, Example 3, and 
Ki3a{q,q) denotes the specialization q = t of the double Kostka-Macdonald polynomial 
KfsSiq^t), H, Chapter VI, §8. _ 

As for the limit n — 00 of the cocharge Kostka-Foulkes polynomials K x^(^a"),(a"+''){q) y it 
follows from Corollary that 

hm i^A®{a"),(a"+fc)(g) = — ETT^- ^^-^^ 

n^oo ria[q) 

The next case we are going to consider is the case when 7 = 0, i.e. /ii < a. 

Theorem 8.3 Let X and fi be partitions of the forms ( \8.3i ) and ( ^.Sj ) correspondingly, and 
assume additionally that fii < a. Then 

]i^^A®(a"),/.ffi(a")(g) = ^ , . ^K^a{q,q)K(3\rj,s{q); (8.6) 
hm i^A®(a"),/.®{a") W = TTT-^ • 8.7 

n->oc Ha{q) 



Example 8.4 Take A = (7,3,2), /i = (4,3,2,1,1,1) and a = (4). Then we have a = (3), 
P = (4,4,4,2,1) and 6 = (3,3,3,2,1). The Kostka-Foulkes polynomials -f^A®(a"),At®(a")(Q') 
have been computed in [^], §7, Example 6, as well as the limits 

56 + llg+ 14g2 + 13g3 + 9g4 + 3^5^2g6 
hm AA©(a"),/.®{a")(g) = q 



(l-g)2(l-g3) 

lim Kx(B{a"),,ie{a^'){q) = 
n— >C30 

1 + g + 3g2 + 5g3 + 7g^ + 9q^ + llq^ + 8g^ + 7g^ + 4g^ + q^^ + 



(l_g)2(l_^3) 

First of all, the hook polynomial 

i7„(g) = (l-g)(l-g2)(l-g3) 
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and using the fermionic formula ( |4.2| ) for Kostka-Foulkes polynomials, it is not difficult to 
check that 

i^A(5,i,M)(9) = g'(l,2,5,ll,15,19,20,16,12,8,4,2,l) 
= g3(l + g)(l,l,4,7,8,ll,9,7,5,3,l,l). 

Hence, 

as it has to be according to Theorem (^.71). 
On the other hand, 

X^i^/3\r,,5(g)i^,,a(g,g) = i^{44421)\{21),/3(g)i^(21),a(g,g) 

Now one can check that 

^(4442i)\(2i),/3(g) = g(3,8, 10, 10,6,2, 1), i^(2i),a(g, g) = g + g^; 

^(4442i)\(3),/3(g) = g^(3,5,5,3, 1), ir(3),„(g,g) = 1; 
i^(4442i)\(i3),/3(g) = (1,2,4,5,4,2,1), ir(i3),^(g,g) = 

Therefore, 

5^ir;3\,,5(g)K,„(g,g) = g2(6^ 25, 27, 22, 12, 5, 2) 

= g2(l + g)(6,ll,14,13,9,3,2). 



as it should be according to Theorem ^.31 , ( |8.6| ). 

Finally, we consider the general case: 
Theorem 8.5 Let X and be partitions of the forms ( ^.Sj ) and i\8.3i ) respectively, then 

lim i^A®(a"),/i®{a")(g) = 



n— >oo 



iT,q)\aH^\ ^^^^^ 



1 



lim K X(B{a"),t,®{a"){q) = 7— X -^a,(7®(ll"l-l7l )) (?) -^/3,(5® (ll/3| ))(<?) • 
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Exercises 

1. Let A and fi be partitions, define A + /i to be tlie sum of tlie sequences A and /i: 

(A + = Xi + /ij. 

The operations + and © are dual to eacli otlier, i.e. (A © /i)' = A' + /i'. 
Sfiow tliat if is a partition, tlien 

Kx+.,^+M > KxAq)- (8-8) 



Conjecture 8.6 Let A, /x and v he partitions, then 

Kx^,^^^Aq,t)>Kx,^{q,t), (8.9) 

i.e. the difference K\^y^^^y{q^t) — Kx^^{q,t) is a polynomial in q and t with non-negative 
(integer) coefficients. 

Here Kx^q, t) stands for the double Kostka polynomial introduced by I. Macdonald, |5^ , 
Chapter VI, (8.11). Note that Conjecture |8.6| gives a common (conjectural) generalization of 
inequahties (|8.1| ) and (^]8|). 

Question. Does there exist the limit lim Kx(Su",fiS)u"{q,t) ? 

2. For given integers n > 1 and / > 1, let A and fi be partitions such that |A| = |/i|(modra) 
and < I. Consider two sequences of partitions 

Al :=A + ((^L/+ ) and /i^ := ((/)"^, /i). 

Show that there exist the limits lim Kx^,^j^{q) and lim Kx^.fi^{q), which are formal 
power series in q, but both do not equal to any rational function. 

Problem 8.7 Find combinatorial and representation theoretical interpretations of the latter 
power series. 



For partial answer on this problem see |2^, |3^, |55|. 
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